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ABSTRACT 

Intended to improve language and reading skills of 
selected underachieving students, the 1988-89 Compensatory Language 
Experiences and Reading Program (CLEAR) of the Columbus, Ohio, public 
schools served 4,902 apils in grades 1-8 in 102 schools. The program 
featured individual and small group instruction arranged according to 
pupil needs, as well as projects utilizing computer-assisteri 
instruction (CAI). The program was evaluated through administration 
of the Comprehensive Tests of Basic Skills as pretest and posttest. 
Test results indicated that of 2,352 pupils with good attendance 
records who were native speakers of English, average test score gain 
was 5.9 Normal Curve Equivalent (NCE) points for the 5.7 months of 
instruction, which met the program objective of 1.0 NCE per month of 
instruction. Analysis by grade revealed that the objective was met in 
grades 3 and 4. Average NCE gains for students using CAI were higher 
than those for the regular group in grades 2 and 3 and lower in the 
remaining grades. Recommendations include determining the cause for 
less growth at certain grade levels, continuing the Whole Language 
treatment group, encouraging more parent participation, and improving 
coordination with classroom teachers. (Fourteen tables of data are 
included; appendixes include four additional tables of data, and 
survey and evaluation instruments.) (RS) 
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FINAL EVALUATION REPORT 
LANGUAGE DEVELOPMENT COMPONENT 
COMPENSATORY LANGUAGE EXPERIENCES AND READING PROGRAM 

1988-89 

ABSTRACT 

Program Description: The Compensatory Language Experiences and Reading (CLEAR) 
program served 4902 pupils. Ft ading of the component was made available 
through the Education Consolidation and Improvement Act — Chapter 1 of 1983. 

The purpose of the Compensatory Language Experiences and Reading program 
(CLEAR) was to provide assistance to selected underacnieving pupils in grades 
one through eight in order that they might attain more fully their potential 
for and improvement of language and reading skills. The program featured 
individual and small group instruction arranged according to pupil needs, as 
determined by continued cooperation between the program teacher and the 
classroom tec^cher* Various subgroups of program teachers were provided with a 
total of 18 inservice sessions. 

Within tne CLEAR program there were two projects utilizing Computer 
Assisted Instruction/Computer Management System (CAI/CMS), one at the 
elementary level and one operating in middle school. A variety of computer 
systems was used in the CAI/CMS projects. 

Time Interval: For evaluation purposes, the CLEAR program started on October 
3, 1988 and continued through April 7, 1989. This interval of time gave 114 
possible days of program instruction. Pupils Included in the final 
pretest-posttest analysis mu;t have attended at least 91 days (80Z) during the 
time period stated above. 

Acci vities: Implementation of the program was accomplished through daily 
instructional activities to strengthen and extend regulor classroom instruction 
withi^at pursuing the basic reading ♦•extbooks. Instructional techniques and 
materials based on skill-centered objectives were applied to fit individual 
needs. 

Achievement Objective; The average language/ reading growth for the pupils who 
attended the program for at least 802 of the instructional period will be 1.0 
Normal Curve Equivalent (NCE) point for each month of instruction. Growth will 
be measured by a nationally standardized achievement test of language/ reading. 

Evaluation Design: The major evaluation effort was accomplished through the 
administration of the Comprehensive Tests of Basic Skills , with the exception 
of grade 1, which received the Metropolitan Achievement Tests > Sixth Edition 
(MAT6). Analyses of the pretest to posttest data were primarily in terms of 
NCEs. 

Major Findings/Recommendations: The information collected on the Pupil Census 
Forms indicated the program ^ 3rved 4902 pupils for an average of 3.7 hours of 
instruction per week. The average daily membership in the program was 4000.1 
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puplla. The average days of enrollment per pupil was 93.0 days and the average 
attendance per pupil was 83.5 days. The average number of pupils served per 
teacher was 45.7. r r » k 

The attendance criterion was met by 2897 pupils, which was 59. IZ of che 
4902 pupils served. The evaluation sample consisted of 2352 pupils who met the 
attendance criterion, took the pretest and posttest, and were English-speaking. 

Analysis of pretest-posttest achievement data for the grade 2-8 evaluation 
sample indicated an avsrage gain of 5.9 NCE points for the 5.7 month treatment 
period, or 1.0 NCE point per month of measurable instruction. Grade 1 scores 
have not been reported in the narrative or included in the total program 
averages due to the inappropriateness of the pretest and posttest levels. The 
MAT6 results may not reflect true pupil performance for certain programs and 
groups of pupils. The program (excluding grade 1 results) attained the 1.0 NCE 
point per month criterion score for the program's performance objective. When 
data were analyzed by grade, it was noted that the evaluation criterion was met 
or exceeded in grade 3 (2.1 NCEs per month) and grade 4 (1.3 NCEa per month). 
The evaluation criterion score was not met at grades 2, 5, 6, 7 or 8. 
Comparisons of achievement test data were also made between pupils in the 
CAI/CMS projects and pupils in the same grade levels of the regular treatment 
projects. At the regular primary level (grades 2-3), the average NCE chains for 
the year were 9.4 for the CAI/CMS group and 6.9 for nhe regular group." At the 
Intermediate level (grades 4-5), the average gains for the year were 6.6 for 
the regular group and 5.1 for the CAI/CMS group. At the middle school level 
the average NCE gains for the year were 4.1 for the regular project and 3.6 for 
the CAI/CMS project. Additional coaparisons of NCE scores were made among 
three teaching methods at the primary level for grades 2 and 3. Gains in NCE 
scores for the year among the three teaching methods were as follows: grade 
2— regular group 3.6, Whole Unguage group 2.9, and CAI/CMS group 1.4; and 
grade 3— Whole Language group 12.3, regular group 12.2, and CAI/CMS group 10.7. 

Process evaluation at the primary level focused mainly on implementation of 
the CLEAR-Primary pilot Whole Language units of the CLEAR-Elementary project. 
Data obtained from on-site observations indicated strong evidence that the 
program was being implemented at the time of the visits. One concern expressed 
by some teachers in the pilot group involved how to coordinate with classroom 
teachers given program scheduling problems. 

Interviews conducted with regular and CAI/CMS middle school teachers 
indicated problems in the following areas: parent involvement, joint planning 
with classroom teachers, temperature/ventilation in reading labs, testing 
environment during the posttest, delays in receiving test result?, and delays 
in gettitig work-orders filled. The area of class scheduling received high 
ratings at the middle school level. 

A cuestionnaire distributed to teachers in CAI/CMS labs indicated that a 
variety of Loaputer systeus was used in the CAI/CMS portion of the program. 
The most prevalent computer system was Prescription Learning which was used at 
the elementary level. For the most part, oupils worked at a computer station 
between 40 and 50 percent of their program instructional time. 

Based on evaluation results, it i3 reconmiended that the CLEAR program be 
continued during the 1989-90 school year. In addition, program recommendations 
include: (a) try to determine cause for less growth at certain grade levels; 
(b) continue the Whole Language treatment group (c) actively encourage more 
parent involvement; (d) send home reading materials for pupils to read at home 
and involve parents in the process; and (e) loprove coordination with classroco 
teachers. 
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Education Consolidation and Improvement Act - Chapter 1 

FINAL EVALUATION REPORT 
LANGUAGE DEVELOPMENT COMPONENT 
COMPENSATORY LANGUAGE EXPERIENCES AND READING PROGRAM 

July 1989 



Program Description 

The purpose of the Compensatory Unguage Experiences and Reading (CLEAR) 
program was to provide assistance to selected underachieving pupils in grades 
one through eight in order that they might attain more fully their potential 
for and improvement of language and reading skills. To accomplish this purpose 
the program featured individual and small group instruction arranged according 
to pupil needs, as determined by continued cooperation between the program 
teacher and the classroom teacher. Instructional techniques and materials 
based on whole-language techniques and skill-centered objectives were applied 
to fit individual needs. Inservice was provided for program teachers. 

The CLEAR program first operated in 1978-79 when previous Primary and 
Intermediate Language Development Programs were combined to achieve greater 
continuity aad consistency of service for elementary school pupils. The first 
Computer Assisted Instruction/Computer Management System (CAI/CMS) unit in the 
CLEAR program was piloted In the second semester of the 1981-82 school year in 
one elementary school. In 1988-89 the CLEAR program was staffed by 128 
teachers serving 102 public and seven non-public Chapter 1 eligible schools. 
Of the 102 public schools, 26 were middle schools. Of the 128 teachers in the 
program, 36 utilized computers in their instruction, and 48 primary teachers 
participated in a pilot group utilizing a whole-language approach. Twenty-four 
of the 36 CAI/CMS teachers served in both the CLEAR program and the Mathematics 
Improvement Component. Evaluation of the Mathematics Improvement Component is 
reported separately (Thomas, 1989). Eight of the primary teachers served in 
both the CLEAR pilot group and In the CLEAR-Reading Recovery project. 
Evaluation of CLEAR-Readlng Recovery will be reported in a separate report. In 
terms of full-time equivclency (PTE), the CLEAR program was staffed with 107.25 
teachers. Each teacher provided services to a maximum of 40 elementary pupils 
or to a maximum of 56 middle school pupils at any given time , with the 
exception of the CAI/CMS units. Since the use of microcomputers was intended 
to expand the number of pupils served, elementary and middle school CAI/CMS 
teachers served^ a maximum of 60 pupils. Those serving both reading pupils and 
mathematics pupils served a maximum of 28 to 32 pupils in each project. 

Within the CLEAR program three projects (elementary, middle, and 
non-public) received regular reading Insrruction and two projects utilizing 
Computer Assisted Instruction/Computer Management System (CAI/CMS) operated at 
the elementary and middle school levels. The elementary CAI/CMS project, 
serving grades 1-5, operated with 29 teachers in 26 schools, and the middle 
school CAI/CMS project operated with seven teachers in seven schools. A 
variety of computer systems was used In the CAI/CMS projects. In addition to 
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providing a technique for reading and language instruction, the use of CAI/CMS 
was also intended to enable parclclpatlng teacb-rs to s-ve iDore pupils than 
would be possible in the regular CLEAR projects. The use of CAI/CMS was also 
intended to be a cost-effective alternative to replacing badly worn 
conventional equipaeat. 

The CLEAR program served a total of 4902 pupils (4756 public and 146 
non-public school pupils). These numbers included the two major kinds of 
program projects— regular and CAI/CMS. Of the 4902 total, 3510 pupils were 
served in the regular CLEAR projects (grades 1-8), and 1392 pupils were served 
in the CAI/CMS projects (grades 1-7). At the primary level (grades 1-3), a 
total of 2365 public and non-public pupils received regular CLEAR treatment 
(whole language pilot group included in this census) while 407 pupils received 
CAI/CMS treatment for a total of 2772 primary grade pupils. At the 
intermediate level (grades 4-5), 182 public and non-public pupils received 
regular CLEAR treatment while 671 received CAI/CMS tr<fatment for a total of 853 
intermediate grade pupils. In middle school (gradee 6-8) a total of 1277 
pupils was served, which included 963 public and non-public pupils in the 
regular CLEAR project and 314 pupils in the CAI/CMS project. 

Evaluation Objective 

The evaluation objective for the CLEAR program was as follows: 

The average language/ reading growth for the pupils who attended the 
program at least 80Z of the instructional period will be 1.0 normal curve 
equivalent (NCE) point for each month of instruction. Growth will be 
measured by a nationally standardized achievement test of 
language/ reading . 

The program time period established for evaluation purposes was 114 days 
beginning October 3, 1988, and ending April 7, 1989. This time period (114 
days divided by an average of 20 school days per month) is oqual to 5.7 
possible months of instruction. Analysis of pretest-posttest performance was 
contingent on pupil attendance for 9\ days (80Z) of the H4 day period. 

Evaluation Design 

The evaluation design provided for the collection of data in five areas of 
operation for the overall program. The instruments used to collect the data 
are found in Appendix B, ioith the exception of the standardized achievement 
tests. 

i. ECIA Chapter 1 Pupil Census Information 

A locally developed Pupil Census Form (page 39, Appendix B) was 
completed oy program teachers for each pupil served, to provide the 
following information: days of program enrollment, days of program 
atfrendance , and hours of instruction per week. The form also 
included information regarding the pupil's grade and sex, provided 
for identifying those pupils who were non-English speaking, provided 
for identifying any pupil who left the ECIA program * ecause he or she 
qualified for a special education program, and included a question 
regarding a pupil's progress which requirca a subjective response 
from the program teacher. Collection of these forms was conplv.ed in 
May 1989. 
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2« Standardized Achievement Test Information 



Except at the first grade, program pupils were administered the 
Comgreheaiive Tests of ^^ aic Skills (CTBS, i98i). This test series, 
which is published by CiB/McGraw-Hill , has empirical norms for fall 
and spring, sstsblishsd October 6-10, 19S0, and April 27 co nay i, 
1981. First grade pupils were administered the Metropolitan 





AchlevemeDC 


Tests, 


Sixth Edition (HA7f> 


1985). 


The 




and 


test levels used 


for each srade level 


are listed be] 


Grade 




Pretest 




Posttest 


Test 


Form 


Level 


Subtest 


Form 


Level 


1 


MAT6 


PR 


L 


Total Reading 


PR 


L 


2 


CTBS 


U 


D 


Comprehension 


V 


D 


3/ 


CTBS 


U 


E 


Comprehension 


V 


E 


4 


CTBS 


u 


F 


Comprehension 


V 


F 


5 


CTBS 


u 


G 


Comprehension 


V 


G 


6 


CTBS 


u 


G 


Comprehension 


V 


G 


7 


CTBS 


u 


H 


Comprehension 


V 


H 


8 


CTBS 


u 


H 


Comprehension 


V 


H 



Subtest 

Total Reading 

Comprehension* 

Comprehension 

Comprehension* 

Comprehension 

Comprehension 

Comprehension* 

Comprehension 



^Estimated by administration of customized Form V 



All testing was done on level. At posttest time, grades 2, 4, and 7 
were administered customized tests that provided norm-referenced as 
well as criterion-referenced scores. The customized tests were 
developed by Columbus Public Schools personnel in cooperation with 
CTB/McGraw Hill to match the Columbus Public Schools Graded C ourse cf 
Study . 

The achievement tests were administered as follows: Program teachers 
in grades 1-8 normally administered the pretest except in schools 
where schoolwide testing occurred. Posttests for grades 1-8 were 
administered as part of Districtwide Testing. Program teachers in 
the seven non-public schools (grades 1-8) hfld to administer their own 
pretests and posttests. During schoolwide or Districtwide Testing, 
tests were administered by classroom teachers with program teachers 
serving as proctors. Pretesting occurred during the week of 
September 26-30, 198S; posttesting occurred April 10-14> 1989. 

3. ECIA Chapter 1 Teacher Census Information 

The locally developed Teacher Census Forn: (pages 40-41, Appendix B) 
was designed to pro/ide information regarding characteristics of 
program personnel. Information collected included total years of 
teaching experience, years of Chapter 1 teaching experience, college 
degree level attained, and certificate in reading. The form was 
completed by Chapter \ program teachers in September 1988. 
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4. Parent Involvement Information 

The Parent Involvement Form (Appendix B, pages 42-44) was constructed 
locally to collect data on the level and nature of parental 
Involyement in Chapter 1 programs. Data ^ere reported by program 
teachers on a monthly basis, Sept-^mber 1988 through June 1989. 
Monthly data included number of parents and number of hours involved 
in five CRcegories of parent involvement, including a monthly 
unduplicated count of parents involved. In addition, a yearly 
unduplicated count of parents was collected at the end of the school 
year* 

5. .nservice Evaluation Information 

The locally developed General Inservice Evaluation Form (page 47, 
Appendix B) was designed to obtain teacher perceptions regarding each 
inservice session. The form was administered tc participants at the 
close of inservice sessions held for Chapter 1 staffs. A modified 
version of the form (pages 45-46, Appendix B) was used for the 
orientation meeting of September 6, 1988. Dates and topics of 
inservice meetings conducted by Chapter 1 in which CLEAR teachers 
participated are shown in Table 1. Teachers completed inservice 
evaluation forms for all of the 18 inservice meetings except those 
occurring on the following daces: August 31 (Pilot Primary), 
September 2 (Elementary CAI and Middle School CAI), and February 22 
(Elementary CAI). 

In addition to the types of data specified in the evaluation design, three 
types of '^-ocess evaluation were obtained. Observations were conducted in 14 
(29.2Z) of the 48 units that piloted the Whole Unguage approach in the regular 
CLEAR primary grades. The purpose of these observations was to determine the 
extent to which guidelines for the Whole Language approach vere implemented. 
'^^e obaervations were conducted by a program evaluator using a locally 
conctructed instrument, the Evaluator's Visitation Log . At the middle* school 
level on-site visits were used to conduct teacher interviews using a locally 
developed instrument, the Evaluator's Interview Lo^ . Interviews centered on 
teachers' ratings of various aspects of the program and on calculating the 
amount )f time used in various instructional activities. One additional 
locally constructed instrument, informally referred to as a computer census 
form, was used as a questionnaire in the CAI/CMS portions of the CLEAR 
program. This instrument had two purposes: to delineate and describe the 
various computer systems used in CAI/CMS labs, and to determine the percent '.f 
program time pupils worked at the computer in the different computer systems. 

All three process evaluation instruments are found in Appendix B (pages 
48-56). Findings from the collection of data from these instruments are 
summarized in this report in the section. Process Evaluation Information , page 
23. The full interim reports are on file at the Department of Evaluation 
Services, Columbus (Ohio) Public Schools (Chamberlain, 1989; Chamberlain and 
Lore, 1989; and Lore, 1989). 

Major Findings 

Pupils were selected for the program on the basis of previous achievement 
test scores which Indicated they were achieving at or below the 36th percentile 
in reading skills. Selection testing occurred prior to the program protest. 
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Table 1 



Dates and Topics of the 18 Inservice Meetings Conducted by Chapter 1 

for School Year 1988-89 



Date 


Title of Inservice 


August 31 


"Housekeeping*' 


September 2 


CAI Training 


September 6 


Opening Conference 


October 6 


Early Strategies Instruction 


October 7 


Early Strategies 


October 19 


Early Reading Strategies 


October 20 


Principles of Effective Instructio 


November 1 1 


Language, Learning, and Literacy 


November 17 


Whole Language Workshop 


December 6 


Developing Theme Units 


January 6 


Teaching for Strategies 


and 10 


Februaiy 8 


Library Resources (AM), ^k)tivation 


February 10 


Holt Impressions Materials 


February 14 


Teaching for Fluency 


February 22 


Learning Consultants, Inc. 


*Keeting also 


attended by five regular teachers 



CLEAR-E lementarv 



Regular Pil^^ CAI CAl" 

(Grades 1-5) (Primary) (Grades 1-5) Aides 



CLEAR-Middle 



Regular CAI 



X 
X 



X 
X 
X* 
X* 



X 
X 



X 
X 



X 
X 



X 
X 



(Table Continued) 
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Table 1 (Continued) 

Dates and Topics of the 18 Inservice Meetings Conducted by Chapter 1 

for School Year 1988-89 



, CLEAR-Elementary CLEAR-Middle 

Regular Pilot CAI CAI 
22l£ Title of Inservice (Grades 1-5) (Primary) (Grades l>-5) Aidep Regular CAI 

Februd' ' 24 Sharing Workshop X 

April 17 Prescription Learning Spring Workshop X X 

May 3-5 End-of-Year Procedures y 



Total Number of Inservice Sessions Provided 

For Each Croup Of ProMrau Personnel 5 10 
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Pupil Census Infcrnation 

A total of 4902 pupils. Including 4756 pupils In public schools (grades 
1-8) aod U6 In non-public schools (grades 1-8), was sc>rved by the ECU Chapter 
1 CLEAR ptograa during the 1988-89 school year for an average of 3.7 hours of 
Inatruction ptr week. Of the 4902 pupils, 3625 were in grades 1 through 5 and 
1277 attend^ middle schools. Of the 4902 pupils, 2547 elementary pupils 
(grades 1-5) and 963 middle school pupils (grades 6-8) received regular CLEAR 
instrtiction, and 1078 elementary pupils (grades 1-5) and 314 middle school 
pupils vgrades 6-7) received CAI/CMS instruction. The 146 non-public 
elementary and middle school pupils were all served in the regular CLEAR 
projects and were included in the regular CLEAR pupil census. 

The average daily membership in the overall program was 4000.1 pupils. The 
average days of enrollment per pupil was 93.0 days, and the aver.^ge attendance 
per pupil was 83.5 days. The iverage number of pupils served per teacher 
during the school year by the 107.25 PTE teachers was 45.7, although the 
average number of pupils enrolled per teacher at any given time was 37.3 
(Average Daily Membership divided by number of PTE teachers). The attendance 
criterion was met by 2897 pupils, or 59. IZ of all program enrollees. Data 
p staining to enrollment and attendance are presented in Table 2. 

The evaluation sample was limited to pupils who had both pretest and 
posttest administrations of the standardized achievement test, were 
English-f -eaking, and met the attendance criterion of at least 80% of the 114 
program days (91 or more program days). 

Of the 4902 pupils served, 25 (0.5Z) were non-Englis^^ speaking. An 
additional 2525 w.^e excluded from the evaluation sample due to incomplete test 
data and/or not attainment of the attendance criterion. The evaluation sample 
was comprised of the remaining 2352 pupils, which was 48. OZ of the 4902 pupils 
served. Data from testing are presented in Tables 3 and 4. 

Pupil census information also included eac ' teacher's rating of individual 
pupil progress. Of the 4902 pupils served in the program, 1693 (34.5%) were 
rated by their program teachers as making much progress, 2248 (45. 9Z) as making 
some progress, 782 (i6.0Z) as making little progress, and 179 (3.7Z) as making 
no progress. 

Standardized Achievement Test Information 

Included in the standardized achirvement test information on the following 
tables — but not in the narrative— are results from grade 1 testing. Caution is 
advised in the interpretation of grade 1 test scores because the test scores 
obtained from the administratic of '^'le MAT6 at grade 1 may not reflect true 
pupil performance in all cases due to the inappropriateness of the test levels 
used at the time of the pretest and posttest. The pretest level was found to 
be too difficult for low-achieving pupils, while the posttest level was found 
to be too easy for the average and above-average pupils. 

Normal curve equivalents (NCEs) are generally considered to provide the 
f uest indication of pupil growth in achievement since they provide comparative 
information in eq-ial units of measurement. Data for normal curve equivalents 
are presented in Table 3. The overall .-..rage NCE change for the CLEAR program 
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Table 2 

Number of Public and Non-public Pupils Served; Averages for Days of Enrollnient. Days of Attendance, 

Dally Membership and Hours of Instruction Per We k; and 
Pupils Attending 80Z of Days 
Reported by Grade Level 
1988-89 





Pupils 
Served 










Average 




Pupils 
Attending 
80Z of Days 


Grade 


Girls 




Days of 

7 n r /\ 1 litriAn^ 


Days of 
At tendance 


Dally 
Membership 


Hours of Instruction 
per Pupil per Week 


1 


755 


333 


422 


82.0 


74.0 


543.3 


3.6 


351 


2 


1178 


9 


659 


93.5 


85.1 


966.5 


3.8 


735 


3 


839 


416 


423 


93.1 


84.5 


685.0 


3.7 


515 


4 


518 


235 


283 


97.2 


86.5 


441.6 


3.7 


320 


S 


335 


168 


i67 


95.7 


86.8 


281.2 


3.7 


225 


6 


1082 


468 


614 


97.5 


85.5 


925.4 


3.6 


635 


7 


155 


69 


86 


90.8 


79.4 


123.5 


3.5 


90 


8 


40 


17 


23 


95.8 


85.7 


33.6 


3.7 


26 


Total 


4902 


2225 


2677 


93.0 


83.5 


4000. 1 


3.7 


2897 
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Table 3 



Minimum, Maximum, Average, and Standard Deviation of the 
Pretest and Posttest Normal Curve Equivalents (NCE) 
Reported by Grade Level 
1988-89 



Pretest Posttest 



Grade 


Pupils 
in Sartple 


Mln. 


Max. 


Average 

NCE 


Standard 
Deviation 


Min. 


Max. 


Average 
NCE 


Standard 
Deviat ion 


Average 
Chanse 
(Criterion - 5.7) 


1 


200 


10.4 


72.8 


30.6 


9.7 


1.0 


99.0 


31.1 


23.0 


0.5 


2 


513 


23.0 


79.0 


33.0 


10.3 


I.O 


91.0 


36.0 


16.4 


3.1 


3 


484 


1.0 


64.0 


28.8 


14.0 


2.0 


79.0 


40.6 


11.9 


11.8 


4 


292 


14.0 


68.0 


32.1 


13.0 


4.0 


71.0 


39.4 


11.6 


7.6 


5 


214 


18.0 


66.0 


33.3 


11.2 


11.0 


59.0 


36.0 


11.1 


2.7 


6 


57b 


1.0 


69.0 


32.5 


13.2 


2.0 


89.0 


36.4 


10.5 


3.9 


7 


60 


15.0 


52.0 


34.7 


9.0 


11.0 


67.0 


39.8 


10.8 


5.1 


8 


13 


11.0 


60.0 


29.6 


13.5 


2.0 


54.0 


31.0 


15.9 


1.4 


(Excluding Grade 1) 
Total 2152 






31.3 


12.5 






37.7 


12.8 


5.9 



ic 
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(ixcludlng grade 1) was 5.9. In the following narrative the achievement test 
results from the grade 2-8 evaluation sample are discussed. The average NCE 
gain p-5r nonth In the 5.7 month period between pretest aud posttest was 1.0 NCE 
point per aonCh, which met the evaluation criterion of 1.0 NCE point for each 
month of Instruction. The evaluation criterion was met or exceeded at grades 3 
and 4. The NCB gain in grade 3 was 11.8 overall, or 2.1 NCEs per month; the 
gain In grade 4 was 7.6 overall, or 1.3 NCEs per month. Smaller NCE gains were 
made at grade 2 (3.1 overall, 0.5 per month); grade 5 (2.7 overall, 0.5 per 
month); In grade 6 (3.9 overall, 0.7 per month); grade 7 (5.1 overall, 0.9 per 
month); and In grade 8 (1.4 overall, 0.2 per month). 

It should be kept in mind that NCEs are based on percentiles which compare 
the pupil's performance in relation to the general population. For a pupil's 
NCE score to remain the same at posttest as at pretest does not denote a lack 
of absolute progress; on the contrary, it means that the pupil has maintained 
the same relative position in terms of the general population. Even a small 
gain in NCEs Indicates an advancement from the pupil's original level of 
achievement. For readers interested in percentile and grade equivalent 
statistics, see Tables 15-18 In Appendix A (pages 34-37). 

lable 4 contains data related to the changes in NCE scores for the three 
ranges: (a) No Improvement in NCE scOi.es (0.0 or less), (b) some Improvement in 
NCE scores (0.1 to 5.6), and (c) substantial improvement in NCE scores (5.7 or 
more). The data Indicate that 1415 (65. 8Z) pupils made gains in NCE scores. 
This means that 65. 8Z of the pupils in the grade 2-8 evaluation sample 
progressed at a rate that was greater than normal for them. More specifically, 
1063 (49*4Z) made substantial improvement and 352 (16. 4%) made some improvement 
In NCE scores, while 737 pupils (34. 2Z) cf the evaluation sample made no 
improvement in NCE performance. 

Tables 5-9 present comparisons between the projects (elementary and middle 
school levels) receiving computer assisted instruction/computer management 
system (CAI/CMS) in reading and those projects (elementary and middle school 
levels) receiving the regular program instruction. For the purpose of these 
comparisons "regular" refers to all pupils not in the CAl/CMS group. 

A' Indicated in Table 5, 1392 pupils were served in two CAI/CMS projects 
(1078 pupils in the elementary project and 314 pupils in the middle school 
project). The total number of public and non-public school pupils in grades 
1-8 who were served in the regular projects was 3510. which included 2547 
pupils in grades 1-5, and 963 pupils in grades ^-8i The average daily 
membership totaled 1160.9 in the CAI/CMS projects (901.9 pupils in grades 1-5 
and 259.0 pupils in the middle school project). Average dally membership in 
the CLEAR regular projects totaled 2839.2 (2015.7 pupils in grades 1-5 and 
823.5 pupils In the middle school)* 

A census of the evaluation samples in the CLEAR elementary (grsJes 1-5) 
projects showed that they were comprised of 583 pupils who received CAI/CMS 
treatment and 1120 pupils in the regular treatment group. Middle school 
samples consisted of 151 pupils in the CAI/CMS instruction group, and 498 
pupils in the regular instruction group. The total number of public and 
non-public school pupils in grades 1-8 in the evaluation sample was 2352. 
Although grade 1 is included in this census of the evaluation sample, grade 1 
was not Included in the summary statistics for achievement test information on 
the tables for reasons cited earlier m this report. 
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Grade 



Grade 1 

Number of Pupils 
Z of Pupils 

Grade 2 

Number of Pupils 
Z of Pupils 

Grade 3 

Number of Pupils 
Z of Pupils 

Grade A 

Number of Pupils 
X of Pupils 

Crsde S 

Number of Pupils 
Z of Pupils 

Grade 6 

Number of Pupils 
Z of Pupils 

Grade 7 

Number of Pupils 
Z of Pupils 

Grade 8 

Number of Pupils 
Z of Pupils 



Table 4 

Change Categories for NCE Scores for Total CLEAR 
Program by Grade Level 
1988-89 



Pupils 
in Sample 



^ Change Categories 

No Iraprovement Some Improvement Substantial Improvement 
(0,0 or l ess) (Q.l to 5,6) (5,7 or more) 



200 
8,5Z 



513 
21, 8Z 



484 
20, 6Z 



292 
12, 4Z 



214 
9,1Z 



576 
24, 5Z 



60 
2,6Z 



13 

0,6Z 



er!q 



Total Group (Fxcludlng Crade 1) 
Number of Pupils 2152 

X of Pupils loo.o:; 
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103 
51. 5Z 



216 
42. IZ 



88 

18. 2Z 



94 

32. 2Z 



80 

37. 4Z 



232 
40. 3Z 



20 

33.33; 



7 

53. 8X 



737 
34.2% 



25 

12.52 



61 

11.92 



71 

14.72 



44 

15.12 



47 

22.02 



117 
20.32 



10 

16.72 



2 

15.42 



352 
16.42 



72 

36.02 



236 
46.02 



325 
67.12 



154 
52.72 



87 

40.72 



227 
39.42 



30 

50.0% 



4 

30.82 



1063 
49.4% 



20 



Table 5 

Number of Pupils Served, Averages for Days of Enrollment, Days of Attendance, 
Daily Membership and Hours of Instruction Per Week, and 
Pupils Attending 80Z of Days Reported by Grade Level 
for Pupils Receiving Reading Instruction with Computers (CAI/CMS Groups) 
and Pupils Receiving Reading Instruction without Computers (Regular Groups) 

1988-89 



Grade 



Pupils 
Served 



Girls 



Boys 



Days of 
Enrollment 



Average 



Days of 
Attendance 



Daily 
Membership 



Hrs* of Inst. 
Per Pupil Per Week 



Pupils 
Attending 
80% of Days 



CAI/CMS Group 



1 


22 


1 9 


in 


7 7 


71 • 3 


14.6 


3.6 


10 


2 






ji 




on c 


83. 2 


3.7 


41 


3 


282 




1 SA 


' 0 1 Q 


OO n 

82.9 


226. 3 


3.6 


158 


A 
"t 


1Q7 


1 7Q 




98. 4 


87. 5 


342.6 


3.7 


249 


Q 


97A 
LI *\ 




in 


97.8 


88. 2 


235. 2 


3.7 


187 


U 




1 Jo 


Io9 


94. 5 


82. 5 


252.9 


3.7 


166 


7 


Q 


J 


6 


76.9 


67.6 


6.1 


3.4 


2 


o 
O 


U 


u 


NA 


NA 


NA 


NA 


NA 


NA 


ToCal 


1392 


643 


749 


95.1 


84.7 


1160.9 


3.7 


813 


Rei$ular 


Group 
















1 


733 


321 


412 


82.2 


74.1 


528.7 


3.6 


341 


2 


1075 


473 


602 


93.7 


85.5 


883.3 


3.8 


694 


3 


557 


290 


267 


93.9 


85.3 


458.7 


3.7 


357 


4 


121 


56 


65 


93.3 


83.1 


99.0 


3.8 


71 


5 


61 


27 


34 


86.0 


80.5 


46.0 


3.8 


38 


6 


777 


332 


445 


98.7 


86.6 


672.5 


3.6 


469 


7 


146 


66 


80 


91.7 


80.2 


117.4 


3.5 


88 


8 


40 


17 


23 


95.8 


85.7 


33.6 


3.7 


26 


Total 


3510 


1582 


1928 


92.2 


83.0 


2839.2 


3.7 


2084 
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Achievement data comparisons of Normal Curve Equivalents for the grade 2-8 
•valuadon sample are presented In Table 6. In the regular CLEAR projects, 
grade 3 which was 23. 8Z of the 1427 pupils in the regular sample (grades 2-8) 
had cha greaCast positive change of 12.3 NCE points. In the CAI/CMS projects, 
grade 3 which was 19. 9X of the 725 pupils in the grade 2-7 sample had the 
gr!»aCe8C positive chauge with an average change of 10.7 NCE points. Program 
criterion was aet with 1.0 or more NCEs gained per month of instruction by the 
regular CLE/il grades 3 and 4. These grades comprised 28,2% of the regular 
CLEAR sample. Grades 2, 5, 6, 7 and 8, 71.8Z of the regular CLEAR sample, did 
not meet the criterion. In the CAI/CMS projects grades 3 and 4 or 51. 4Z of the 
CAI/CMS sample met criterion while grades 2, 4, 5, 6, and 7 (48. 6Z) did not. 
Comparisons cannot be made between the middle school regular CLEAR project and 
the CAI/CMS project in grade 8 because there were no pupils in the sample for 
that g-ade in the CAI/CMS project. The average NCE change for the CAI/CMS 
group (grades 2-7) was 5.8 overall or 1.0 NCE per month of instruction and the 
average change for the regular CLEAR groups (grades 2-8) was 5.9 overall or 1.0 
NCE per month. The program's criterion that there be 1.0 or more NCEs gained 
per month of instruction was met in both the CLEAR-CAI/CMS projects and the 
regular CLEAR projects for grades 2-7 and 2-8, respectively. 

Further comparisons between CAI/CMS and regular CLEAR in other grades 
indicate that the regular CLEAR grade 2 group made a 3.2 NCE point change in 
comparison to a 1.4 for the CAI/CMS group. The regular grade 5 group made a 
3.2 NCE point change in comparison to 2.6 for the CAI/CMS group. The regular 
grade 6 group made a 4.0 NCE point change compared to 3.7 in the CAI/CMS, and 
finally the regular grade 7 group made a 5.5 NCE point change compared to -6.5 
in the CAI/CMS group. 

As indicated earlier, NCE scores are generally considered to provide the 
most comparative information in equal units of measurement. Nevertheless, 
additional statistics (Percentile and Grade Equivalent Tables) are included in 
Appendix A (pages 34-37, inclusive) for those readers wanting more statistical 
data. Data in terms of NCE scores for the CAI/CMS projects and the regular 
instruction projects are presented by grade in Table 6 and were included in the 
discussion above. Another indicator of overall program ef f c-ctiveness is 
presented in Table 7, the average NCE growth by group across grade level. At 
the primary level (grades 2-3) the average NCE change across grade levels was 
9.4 NCEs for the CAI/CMS group and 6.9 for the regular group. At the 
intermediate level (grades 4-5), the average NCE change across gradt level was 
6.6 NCEs for the regular group and 5.1 for the CAI/CMS group. At the middle 
school level the average NCE change was 4.1 for the regular project and 3.6 for 
the CAI/CMS project. Grade 8 of the regular CLEAR project is included in these 
data. 



Tables 8 and 9 compare (grades 2-8) of the CAI/CMS and regular projects in 
regard to numbers and percents of pupils who evidenced no improvement, some 
improvement, and substantial improvement, as previously defined. The data 
indicate that 65.93; o£ the regular project pupils made positive gains in NC7. 
scores, while 65.43: of CAI/CMS projects did so. Positive gains In the regular 
projects included 50. 2Z who made substantial improvement and 15.8% who made 
some improvement. Positive gains in tha CAI/CMS projects included making 
substantial improvement, and 17, 5Z asking sczz improveaent. 

The piloting of the CLEAR-Primarjr Whole Language teaching approach made a 
further comparison of NCEs by teaching methods desirable. Three distinct 
teaching methods were possible: regular treatment method, pilot Whole Language 
method, and CAI/CMS treatment method. Comparisons of average NCE scores for 
the three treatment methods are presented in Table 10. 
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Table 6 

MlnimuiCj Maximum, Average, and Standard Deviation of the Pretest 
and Poettest Normal Curve Equivalents (NCE) Reported by Grade Level 
for Pupils Receiving Reading Instruction with Computers (CAI/CMS Groups) 
and Pupils Receiving Reading Instruction without Computers (Regular Groups) 

1988-89 



Pretest 



ERIC 



Pupils 
Grade in Sample 


Min. 


Max, 


Average 
NCE 


Standard 
Deviation 


Min. 


Max. 


Av e r ag e 
NCE 


at anaard 
Deviation 


Avetage 
Change 
(Criterion - 5.7) 


CAI/CMS Group 






















1 


9 


18.9 


31.5 


26.0 


4.8 


1.0 


46.3 


25.3 


17.2 


- 0.7 


2 


23 


23.0 


55.0 


34.8 


10.9 


1.0 


83.0 


36.2 


20.5 


1.4 


3 


144 


1.0 


60.0 


29.9 


14.4 


2.0 


75.0 


40.6 


11.1 


10.7 


4 


229 


14.0 


68.0 


31.6 


13. 1 


4.0 


66.0 


38.6 


11.5 


7.0 


5 


178 


18.0 


66.0 


33.0 


11.2 


11.0 


59.0 


35.6 


11.2 


2.6 


6 


149 


1.0 


60.0 


31.3 


13.8 


2.0 


59.0 


35.0 


10.5 


3.7 


7 


2 


36.0 


39.0 


35.0 


5.7 


26.0 


31.0 


28.5 


3.5 


- 6.5 


8 


0 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


Total* 


725 






31.7 








37.4 




5.8 


Regular Group 






















1 


191 


10.4 


72.8 


30.8 


9.8 


1.0 


99.0 


31.4 


23.2 


0.6 


2 


490 


23.0 


79.0 


32.9 


10.3 


1.0 


91.0 


36.0 


16.2 


3.2 


3 


340 


1.0 


64.0 


23.4 


13.8 


2.0 


79.0 


40.7 


12.3 


12.3 


4 


63 


14.0 


60.0 


33.7 


12.6 


4.0 


71.0 


42.2 


11.6 


8.6 


5 


36 


18.0 


63.0 


34.9 


11. 1 


11. 0 


57.0 


38. 1 


10.? 


3.2 


6 


427 


1.0 


69.0 


32.9 


12.9 


2.0 


89.0 


36.9 


1C.4 


4.0 


7 


58 


15.0 


52.0 


34,7 


9.1 


11.0 


67.0 


40.2 


10.7 


5.5 


8 


13 


11.0 


60.0 


29.6 


13.5 


2.0 


54.0 


31.0 


15.9 


1.4 


Total* 1427 






31.9 








37.9 




5.9 



* (Excluding Grade 1) 



25 



Table 7 



Minimum, Mp^lmum, and Average of the Pretest and Posttest 

Normal C • e Equivalents (NCE) Reported Across Primary, 
Intermediate, and Middle School Grade Levels for Pupils In 
CAI/CHS Projects and Pupils In Regular Instruction Groups 

1988-89 



Grade and 
Treatment 
Group 



Pretest 



Pupils 
In Sample Mln. 



Poettest 



Max. 



Average 
NCE 



Mln. 



Max. 



Pilmary (Grades 2-3) 
CAI/CMS Group 
Regular Group 



167 
830 



1.0 
1.0 



60.0 
79.0 



30.6 
31.0 



1.0 
1.0 



83.0 
91.0 



Totals 



997 



31 0 



Intermediate (Grades 4-5) 
CAI/CMS Group 407 14.0 68.0 32.2 

Regular Group 99 14.0 63.0 34.1 



4.0 
4.0 



66.0 
71.0 



Average 
NCE 



40.0 
37.9 



38.3 



37.3 
40.7 
38.0 



Average 
Change 



9.4 
6.9 



7.3 



5.1 

6.6 
"574" 



Totals 



506 



32.6 



Middle Grades (6-8) 
CAI/CMS Group 
Regular Group 
Totals 



151 
498 



1.0 

1.0 



60.0 

69.0 



31.3 
33.0 



2.0 
2.0 



59.0 
89.0 



649 



32.6 



34.9 
3/. 2 



36.6 



3.6 
4.1 



4.0 
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Table 8 

Frequencies and Percents of Pupils In Normal Curve Equivalent (NCE) 
Change Categories by Grade and Treatment Group 

1988-89 

Change Categorleo 

Pupils No Improvement Some Improvement Substantial Improvement 
In Sample (0,0 or less) (0,1 to 5>6) (5.7 or more) 



Grade and 
Treatment 

Group 
CAI/CMS Group 



Grade 1 

Number of Pupils 9 3 3 3 

X of Pupils 33.3% 33.3Z 33.3Z 

Grade 2 

Number of Pupils 23 10 1 12 

X of Pupils 43. 5Z 4.3Z 52. 2Z 

Grade 3 

Number of Pupils 144 28 24 92 

Z of Pupils 19. 4Z 16. 7Z 53. 9Z 

Grade 4 

Number of Pupils 229 79 31 119 

I of Pupils 34.52 13.5Z 52. OZ 

Grade 5 

Number of Pupils 178 67 41 /o 

Z of Pupils 37. 6Z 23. OZ 39. 3Z 

Grade 6 

Number of Pupils 149 65 30 54 

Z of Pupils 43. 6Z 20. IZ 36. 2Z 



Grade 7 

Number of Pupils 2 2 0 0 



Z of Pupils 100. OZ 0,GZ 



0.0% 



Grade 8 

Number of Pupils 0 NA NA NA 

Z of Pupils 



CAI/CMS Group Totals (Excluding Grade 1) ^ — — 
Number of Pupils 725 251 127 347 
Z of Pupils 1^0% 34. 6Z 17. 5 Z 47. 9Z 
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Table 8 (Continued) 
Frequencies and Percenfs of Pupils in Normal Curve Equivalent" (NCE) 
Change Categories by Grade and Treatment Group 

1988-89 



Grade and 
Treatment 

Group 
Regular Group 

Grade 1 

Number of Pupils 
X of Pupils 

Grad<i 2 

Number of Pupils 
Z of Pupils 

Grade 3 

Number of Pupils 
X of Pupils 

Grade 4 

Number of Pupils 
X of Pupil u 

Grade 5 

Number of Pupils 
X of Pupils 

Grade 6 

Number of Pupils 
X of Pupils 

Grade 7 

Number of Pupils 
X of Pupils 

Grade 8 

Number of Pupils 
X of Pupils 



Pupils 
In Sample 



Change Categories 

No Improvement Some Improvement Substantial Improvement 
(0.0 or less) (0.1 to 5.6) (5.7 or more) 



191 



490 



340 



63 



36 



427 



58 



13 



100 
52. 4Z 



206 
42.0% 



60 

17. 6Z 



15 

23. 8Z 



13 

36. IZ 



16/ 
39.1% 



18 

31.0% 



7 

53.8% 



22 

11.5% 



60 

12.2% 



47 

13.8% 



13 

20.6% 



6 

16.7% 



87 

20.3% 



10 

17.2% 



2 

15.4% 



69 

36.1% 



224 
45.7% 



233 
68.5% 



35 

55.6% 



17 

47.2% 



173 
40.5% 



30 

51.7% 



4 

30.8% 



ERIC 



Regular Group Totals (Excluding Grade 1) 

Number of Pupils 1427 486 
% of Pupils 100% 34c 1% 
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225 
15.8% 



716 
50.2 
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Table 9 

Frequencies and Percents of Pupils in Normal Curve Equivalent (NCE) Score 
Improvement Categories Across Primary, Intermediate, and Middle School 

Grade Levels by Treatment Group 
1988-89 



\JM, ovic aiivi 

Treatment 
Group 


Pupils 
in Sample 




Change 


Cat ego 


rles 


No Improvement 
(0.0 or less) 


Some Improvement 
(0.1 to 5.6) 


Substantial Improvement 
(5.7 or more) 


CAI/CMS Group 
Number of Pupils 
X of Pupils 


167 
16.82 


38 

22. 8Z 


25 

15. OZ 




104 
62.3% 


Number of Pupils 
X of Pupils 


830 
83. 2Z 


266 
32. OX 


1J7 
12. 9t 




457 
55.1% 


CAI/CMS Group 
Number of Pupils 
X of Pupils 


jUO 

407 
80,42 


146 
35.92 


72 

17. 7Z 




189 
46.4% 


RsifulAr GrnuD 

Number of Pupils 

X of Pupils 


99 

19.6% 


28 

28. 3Z 


19 

19.22 




52 

52.5% 


Middle (Grades 6-8) 
CAI/CMS Group 

Number of Pupils 

X of Pupils 


649 

151 
23. 3X 


67 

44.4% 


30 

19. 9X 




54 

35.8% 


Regular Group 

1u* ' M k A 1* ^ r Of anil a 

r:««fflDer 0£ rupxis 
X of Pupils 


49o 
76. 7Z 


192 
38. 6Z 


99 

19. 9Z 




20/ 
41,6% 


Totals for Grades 2-8 


2152 










CAI/CMS Groups 
Number of Pupils 
X of Pupils 


725 
33. 7Z 


251 
34.6% 


127 
17. 5Z 




347 
47.9% 


Regular Groups 
Number of Pupils 
X of Pupils 


1427 
66. 3X 


486 
34. IZ 


225 
15. &Z 




716 
50.2% 
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Table 10 



Average Normal Curve Equivalent (NCE) Scores 
in Grades 1-3 by Treatment Group 
1988-89 



Treatment 
Group 



Pupils 
in Sample 



Grade 1 

Regular 20 

Whole Language 171 

CAI/CMS 9 

Grade 2 

Regular 181 

Whole Language 309 

CAI/CMS 23 

Grade 3 

Regular 178 

Whole Language 162 

CAI/CMS 144 



Total (Grades 1-3) U97" 



Pretest 



Average NCE 



27.3 
31.2 
26.0 

33.9 
32.3 
34.8 

30.4 
26.1 
29. Q 



Posttest Change 
(Criterion - 5.7) 



22.3 
32.4 
25.3 

37.5 
35.2 
36.2 

42.7 
38.4 
40.6 



- 4.9 
1.2 

- 0.7 

3.6 
2.9 
1.4 

12.2 
12.3 
10.7 



As can be seen in Table 10, grade 3 had the largest average NCE changes for 
all methods of teaching. The regular treatment group at second grade had an 
average change of 3.6 NCEa (0.6 average NCE per month); the Whole Language 
group had an average change of 2.9 NCEs (0.5 average NCE per month), while the 
CAI/CMS group had an average change of 1.4 (0.2 average NCE per month). The 
results fro« grade 1 testing are not discussed ia this narrative for reasons 
previously stated. 




3^. 

EVALSRVCS/F502/RPTFCLE89 



20 



Using the dats from the Pupil Census Forms, a conparison was also made 
using teachers' ratings of individual progress of CLEAR-Primary pupils in the 
evaluation sample as they exited the program. The percent of sample pupils 
rated in the highest of four progress categories was as follows for each of the 
treatment groups: CAI/CMS treatment 60.8Z, regular treatment 55. 7Z, and whole 
Language treatment 45. 5Z. The four progress categories included the following 
descriptors: Much Progress, Some Progress, Little Progress and No Progress. 

ECIA-Chapter 1 Teacher Census Information 

Teacher Census Forms were completed in September 1988 by the 128 teachers 
assigned to ECIA Chapter 1 CLEAR units. In terms of full-time equivalence 
(FTE). the program was staffed with 107.25 teachers. All 128 teachers had at 
least a bachelor's degree, 68 teachers (53.1Z) had a master's degree, and one 
teacher (0.8Z) had a doctoral degree. The number of teachers having 
certification in reading as a subject area was 64, or 50. OZ of the program's 
teachers. The average number of years of teaching experience was 20.8 overall, 
and 9.4 in Title I/Chapter 1 teaching experience. Of the 128 program teachers, 
121 had assignments in public schools, and seven in non-public unit?. 
Thirty-six teachers in public schools were assigned to CAI/CMS units and 85 
were assigned to the regular program. All 128 program teachers were full-time 
employees of the Columbus Public Schools with 24 serving two projects (CAI/CMS 
reading and CAI/CMS mathematics), and an additional eight primary teachers from 
the 128 program teachers serving in both the CLEAR-Primary Whole Language pilot 
group and in the CLEAR-Reading Recovery project. 

Although 128 teachers served in the CLEAR program during the school year, 
two were replacements for teachers who left the program during the year: one in 
the regular middle school project and one in the non-public project. The 
actual number of teaching positions in the program was 126. Teacher census 
data are based on the full roster of 128 teach«rs. 

Parent Involvement Informatio n 

The Parent Involvement Form provided information from teachers at the end 
of each month (September 1988 through June 1989) concerning program activities 
involving parents who had children in the program. These data are presented by 
month in Table U. Because teachers in the CAI/CMS projects served part time 
in the CLEAR program and part time in the HIC program, parent involvement data 
from this subset of CLEAR teachers had to be prorated between their two 
programs. This accounts for the statistical oddity of the fractional parents 
encountered in Table U. The month showing the most parent Involvement was 
October with a total of 1821.5 contacts In 1230.4 parent hours. Individual 
parent conferences accounted for more parent contacts (4753.2) than any other 
activity. Yearly totals for the other activities were: group meetings with 
parents, 2018.6 contact' in 2220.6 parent hours; parent classroom visits or 
field trips, 1060.6 contacts in 847.0 parent hours; planning, operation, and/or 
evaluation, 798.7 contacts In 356.1 parent hours; and visits by teacher to 
parents' homes, 73.5 contacts in 44.7 parent hours. The yearly totals for all 
five types of parent activity were 8704.6 parent contacts in 5327.4 parent 
hours. Since a parent could have involvement in more than one contact, a 
yearly unduplicated count was also obtained from program teachers in June. 
This count indicated a total of 3333.3 parents of program pupils had one or 
more contacts with the program during the school year. 
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Table 11 
Number of Parents Involved 
and Total Parent Hours 
Reported by Month 
1988-89 



Items 



Months 



Sept. 



Oct. 



Nov. 



Dec. 



Jan. 



Feb. 



Mar. 



Apr. 



May 



June 



Totals 
for 
Year 



1. Parents Involved In the 
planning, operation and/ 
or evaluation of your 
unit 

Number of Parents 
Total Parent Hours 

2. Group meetings for 
parents 

Number of Parents 
Total Parent Hours 

3. Individual parent 
conf ercncas 

Number of Parents 
Total Parent Hours 

4. Parental classroom 
visits or field trips 

Number of Parents 
Total Parent Hours 

5. Visits by teacher 
to parents' homes 

Number of Parents 
Total Parent Hours 



Total Parent Contacts 
Total Parent Hours 



64.4 
23.5 



190.1 
202.0 



328.9 
111.0 



64.8 
29.5 



7.4 
3.3 



143.6 
60.8 



640.9 
658.6 



685.8 
261.7 



343.0 
245.1 



8.2 
4.2 



118.5 
45.2 



141.4 
17.0.0 



1009.6 
409.8 



88.7 
81.6 



7.7 
5.8 



40.0 
19.2 



87.4 
137.7 



277.0 
110.5 



79.7 
46.2 



1?,0 
6.7 



60.4 
23.8 



57,9 
38.1 



397.5 
140.2 



62.8 
41.0 



6.3 
3.3 



121.6 
53.1 



193.9 
205.4 



832.1 
355.2 



122,7 
111.2 



3.8 
7.7 



36.1 
21.3 



192.0 
216.5 



373.1 
140.3 



82.1 

47,8 



10.0 
4.1 



84.5 
28.8 



112.0 
149.0 



361.6 
132.0 



61.5 
41.9 



8.4 
3.9 



62.1 
49.0 



299.9 
334.5 



321.4 
133.1 



87.9 
91.3 



8.0 
4.5 



67.4 
31.4 



103.2 
158.9 



166.1 
65.2 



67.5 
111.4 



1.6 
1.1 



655.7 1821.5 1366.0 496.1 
369.3 1230.4 662.5 320.4 



584.9 1274.0 693.3 628.0 
246.4 732.6 430.0 355.6 



779.3 
612.4 



405.8 
367.9 



798.7 
356.1 



2018.6 
2220.6 



4753.2 
1859.0 



1 1.6 

b 0 



7j.5 
44.7 



8704.6 
5327.4 
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A separate end-of-tne year teacher survey was used to determine program 
Involveaent by non-program parents. This survey indicated that an additional 
643.4 parents who did not have children in the prograss were involved in 852.2 
contacts with thi\ program in 901.0 parent hours over the school year. 

Tnservice Evaluation Information 

The General Inservice Evaluation Form was completed by program teachers for 
15 of the 18 inservice sessions vhich occurred from September 1988 chrough May 
1989. Respondents rated lOur statements about the inservice on a five-point 
scale ranging from Strougl> Agree (5) to Strongly Disagree (1). See Appendix 
B, page 47. 

Generally, workshop participants rated Chapter 1 inserviob meetings 
positively. Overall ratings by participants are summarized in Table 12. 

Table 12 

Average Response and Percent of Response 
For Reactions to Inservice Statements 

1988-89 



Statements 



1. I think this was 
a very worthwhile 
meeting. 542 

2. The information 
presented in the 
meeting will assist 

me in my program. 540 

3. There was time to ask 
questions pertaining 

to the presentation. 534 

4. Questions were 

answered adequately. 532 



Number Average 
Resp ^ ±ng Response 



Percent 



4.5 



4.5 



4.5 



4.5 



SA A U D SD 
(5) (4) (3) (2) (1) 



57.9 39.1 2.4 0.4 0.2 



58.1 38.5 2.6 0.4 0.4 



53.9 41.4 3.2 0.9 0.6 



54.7 40.2 4.3 0.2 0.6 



Note: The anchors for the rating scale are as follows: SA » Strongly Agree, 
A - Agree, U - Undecided, D » Disagree, and SD - Strongly Disagree. 

Open-ended comments on the General Inservice Evaluation Form asked 
participants to comment about the most and least valuable parts of the meetings 
and about information they would like to have covered in future meetings. Only 
those open-ended comments which were made by five or more pai. ticipants at any 
single session will be summarized here. However, the evaluation reports on 
individual sessions have been forwarded to the Department of Federal and State 
Programs and are available on request from the Department of Evaluation 
Services. 
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In regard to the most valuable parts of the inservice meetings, the 
following Items were notable from the opening conference In which teachers from 
all projects of the program were present! the main speaker, Mrs. C.J. Prentiss; 
Dr. Etharldga's speech; the conmerclal exhibits; the program coordinators' 
■ini -sessions; and the entire meeting. In other meetings during the school 
ye^«-, which were provided to various subgroups within the CLEAR program, the 
fi owing Items received five or more favorable comments in a meeting: a visit 
by elementary CAI teachers to the Integrated Language Arts (ILA) computer lab 
at West Broad Street Elementary school; Information about the Ubrary Resource 
Center at Seventeenth Avenue, and also touring the stacks avi selecting books 
durltig an Inservice at that facility provided for middle school regular and CAI 
teachers; sharing of Ideas and materials by program teachers at a regular 
elementary Inservice, and Idea-sharing presentations hy program teachers at an 
Inservice for middle school regular and CAI teachers; hands-on activities with 
computers at an elementary CAI Inservice; Dr. Thrope's presentation to middle 
school regular and CAI teachers; Sue Hundley's presentation to primary 
teachers; Sandy Snide's presentation to primary teachers on making books; and 
making a book at an Inservice for elementary regular and CAI teachers. 

The question regarding the least valuable parts of meetings elicited one 
critical comment with a frequency of five or more at a meeting for primary 
teachers: too much time spent on questions dealing with individual problems. 
In two other meetings, the opening conference and a meeting for elementary 
regular and CAI teachers, the only response to this question with a frequency 
of five or more was that nothing was least valuable or that all was valuable. 

The question dealing with suggestions for future meetings elicited 
suggestions in only one area with a frequency of five or more: parent 
inv:>lvement or parent meetings. 

Process Evaluation Information 

In addition to the types of data specified in the evaluation design, 
process evaluation data were obtained In a series of on-site visits to CLEAR 
units at the primary and middle school levels and by means of a mailed 
questionnaire to the CAI/CMS projects. Of the 71 (65 public and six 
non-public) teachers in the regular 1988-89 CLEAR-Elementary projects, 48 
primary teachers piloted a Whole Language approach to reading. Of these, 14 
(29. 2Z) were randomly selected to be visited. This year visits were a 
continuation of the monitoring begun during the first /ear of the Whole 
Unguage pilot program to document implementation. in addition, the process 
evaluation served to Increase the program evaluator's familiarity with the 
operation of the projects by on-site observation. The visits were conducted by 
the program evaluator during the period from February 23 to March 7, 1989. The 
purpose of the visits was to determine to what degree guidelines for 
whole-language techniques, management, and environment were Implemented in 
these units. 

For these visits, a locally developed Instrument, Evaluator's Visitation 
Log (pages 48-51, Appendix B) , was constructed to gather information about 30 
artifacts which were indicative of so Implemented program. These items were 
categorized into the following seven major facets: Literate Environment for 
Pupils, Administrative Procedures and/or Record Keeping, Materials and 
Facilities, Lesson Management, Instructional Efficiency and Monitoring, 
Classroom Climate, and Parent Involvement. 



O 3Q 
ERJC EVALSRVCS/P502/RPTFCLE89 



'>4 



The evaluator was to look at each item listed under each major facet of 
iapleaentation and rate it on a three-point scale where the anchors No Evidence 
waa rated aa (0), Some Evidence waa rated as (1), and Compelling Evidence was 
L'ated as (2). To determine which response choice* to make, the observer was to 
look for a predetermined kind of evidence which waa indicated in parentheses 
next to the iter. If the preselecter* evidence were not found, th^n the 
observer was instructed to look for one of the other kinds of evidence. 
Evidence was of three kinds: Physical Evidence (PE), Observational Evidence 
(0£), and Testimonial Evidence (IE). 

As can be seen from Table 13. it is apparent that implementation was being 
accomplished at the tiaie of the visits. The lowest Overall Average Rating wis 
1.9 which approached the maximum rating of 2.0. 



Table 13 

Overall Average Ratings for the Process Evaluation Facer c 
of the CLEAR-Primary Whole Language Units 
of the Regular CLEAR-Elementary Project 
1988-89 
(N«14) 



Overall Average Rating 
Across Units/Across Items 



Literate Environment for Pupils 


i>9 


Administrative Procedures and/ 




or Record Keeping 


2*0 


Materials and Facilities 


* 


Lesson Management 


* 


Instructional Efficiency and 




Monitoring 


1.9 


Classroom Climate 


2.0 


Parent Involvement 


1.9 



*It should be noted tht^t all items in the facets, "Materials and 
Facilities*' and "Lesson Management,^' were noC rated for every teacher; 
therefore, an Overall Average Rating could not be given those facets. 

The only facets not having an Ovirall Average Rating were Materials and 
Facilities and Lesson t*^nagement because some items were discretionary and 
dependent upon each program teacher's lesson plans. Consequently, all items 
under these facets were not rated. To meet the set criterion for Lesson 
Management, units had to display at least two of the eight activities listed. 
The actual number the observer rated was 4-8 items in every unit. The average 
number for the 14 units was 5r8. Therefore, all units met criterion. For two 
of the items urder C:>e facet , Materials and Facilities, teachers could use 
either Holt materials and/or supplemental materials. There was no Overall 
Avk^rage Raring given this facet because all three items were not always rated. 
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A specific concern of teachers involved Item 24 of the Instructional 
Efficiency and Monitoring facet. This item dealt with coordination with 
clMcrooa teachera as indicated by lesson plans. Comments were centered aroiind 
prograa teachars' conceras chat classroom teachers wanted all of their pupils 
to go tc CLEAR at one time—no matter what basal readers the pupils were 
reading,. Another concern involved the number of different classrooms 
represented in each CLEAR class period. How to coordinate with classroom 
teachers giv<y.n these problems continued to be a concern of program teachers who 
wanted help in meeting this requirement of the program. Several relatively 
minor administrative problems were reported to the appropriate Department of 
Federal and State Prog rai&8 (DFSP) personnel • 

On-site visitations at the middle school level were conducted by two 
program evaluators in March 1989 and featured teacher interviews based on a 
locally developed instrument, the Evaluator's Interview Log (Appendix B, pages 
Seven (36,8Z) of the 19 regular CLEAR-Middle teachers and ail seven 
CLEAR-Middle-CAI teachers were interviewed. Of the 19 regular CLEAR-Middle 
labs, it was found that one had been converted mid-year to a CAI/CMS It For 
evaluation purposes this lab has been counted according to its original project 
statU'i, with the exception of the computer census data summarized later in this 
reporr* The interview instrument consisted of 30 items using a five-point 
rating scale and a final item involving time spent on various instructional 
activities. Rating scale items were grouped by area of concern. Average 
ratings were dichotomized as high (4.0 or higher) and low (less than 4.0). 

Ratings indie. ited problems in both middle school projects in the following 
areas or aspects; parental response to efforts at parent involvement, joint 
planning with clas5».oom teachers, temperature/ventilation in the reading labs, 
problems attendant to testing, and the length of timp It takes to get 
evaluation feedback. 

The area of class scheduling received high average ratings in both 
projects. Materials received high ratings in both projects with the exception 
of condition of materials in the regular CLEAR-Middle project. Group pupil 
progress received high ratings as perceived by CLEAR-Middle-CAI teachers, but a 
lower rating by regular CLEAR-Middle teachers. Other areas received mixed 
ratings in regard to project and/or specific aspect^ 

In addition to the rating scale items, the instrument addressed the percent 
of instructional time devoted to various types of activities. Computer 
activities accounted for the largest allotment of t ae (38. OZ) in the CAI/CMS 
project. The largest non-computer activitiy in both projects was sustained 
silent reading, at 18.62 in regular CLE ..R-Middle , and 13.72 in 
CLEAR-Mlddlt-CAI. Other activities using 10% or more of instructional time 
were individual seatwork in regular CLEAR-Middle (15.72) and listening to a 
lecture or a story (12.9Z) in regular CLEAR-Middie. 

Open-ended comments from program teachers v; re also recorded. Some of the 
specific concerns expressed were the following: lack of student number and full 
first name on the fall 1988 selection printout which made it harder to use; 
poor testing environment during the posrtest, when rest is given as part of 
Districtwide testing; d*»lays in getting work-orders filled; and delays in 
receiving test results. 
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One additional locally constructed instrument, informally referred to as a 
computer ceaaus form, was used in the CAI/CMS projects of the CLEAR program. 
This ingtrunent had two purposes: to delineate and describe the various 
computer ayateas used in the CAI/CMS labs, ard to determine the percent of 
program time pupils worked at the computer in the different computer systems. 
This questionnaire was completed by program teachers in February 1989 (see pase 
56, Appendix B). * 

TWenty-two elementa«:y labt» have Apple microcomputers and are served by 
Preacrlption Learning Compsny, Prescription Learning (PL) elementary labs are 
equipped with six Apple microcomputers, one of which is used for the teacher's 
in-lab management system and for hands-on testing. Additional teaching 
machines are also utilized in these labs. Nineteen of the twenty-two PL labs 
are also used a half day in the CLEAR program, and a half day in the 
Mathematics Improvement Component (MIC). 

An additional Prescription Learning lab of another type was piloted this 
year in one school. This is know., as an Integrated Language Arts (ILA) lab. 
It consists of ten Apple microcomputers Joined in a network system with an Acer 
microcomputer used as the teacher's management station. This lab serves pupils 
in the CLEAR program only. 

Two elementary labs have Tandy TRS-80 color microcomputers, serviced by the 
B&B Company. Each of these labs is equipped with six computers for pupil use 
but do not have a command mcdule/teacner management system. These labs serve 
pupils in the CLEAR program only. 

One elementary lab uses the Sperry Network System and is s-rviced by 
Wasatch. The Wasatch lab networks four Sperry microcomputers and one aT&T 
microcomputer as student stations, plus a fifth Sperry microcomputer which Is 
limited to teacher use as a command nodule. The elementary Wasatch lab serves 
pupils in the reading/ language program and ca math program. A second Wasatch 
lab was added in the same school in January. The second Wasatch elementary lab 
networks eight Tandy 1000-SL microcomputers as student stations, and a 
Tandy-4000 used as the teacher station. The Wasatch Tandy lab is used only in 
the CLEAR program. 

Two labs in one school are served by Computer Curriculum Corporation 
(CCC). A central CCC microhost is hooked up to the individual microcomputers 
in the two labs. Each lab has a total of eight microcomputers for pupil use: 
four Apple and four Atari. In addition, each lab has a fifth Atari which is 
used as a teacher management system. Pupils In both the CLEAR program and the 
MIC program ar« served in these labs. 

Three middle school labs use Dolphin Binlcomputers . A Dolphin lab consists 
of a Dolphin minicomputer with seven pupil terminals,, plus a command module 
terminal which can also be used as another pupil station. The central 
minicomputer is hard-programmed with educational and management routines. The 
Dolphin labs were originally serviced by Houghton-Mifflin Company, but the 
service contract this year is with B&B Company. The Dolphin labs are used in 
the CLEAR program only. 

A Wasatch lab operates in one middle »chool. The Wasatch lab networks four 
Sperry microcomputers, three Tandy microcomputers, and one AT4T microcomputer 
for a total of eight pupil stations, plua an additional Sperry microcomputer 
which is limited to teacher use as a command module. The middle school Wasatch 
lab is used in both the CLEAR program and the MIC program. 
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Three middle school labs use Tandy 1000-SL microcomputers. These labs are 
serviced by Educational Systems Corpocation (£SC) for software, and by Tandy 
7^0^'"**'^°° hardware. A middle school Tandy lab networks eight Tandy 

1000-SL microcomputers as pupil stations and one Tandy 3000 microcomputer as a 
teacher station, all linked to a central host. All three middle school Tandy 
labs are used in the CLEAR program, and one is used also in the MIC program. 

In January one of the conventional labs in the CLEAR-Middle School proiect 

was converted to a CAI/CMS lab. The new lab uses Wicat Systems, and Is 

serviced by the Wicat Systems Company. The Wicat Systems lab uses a central 

processing unit, a host, eight pupil terminals, and a teacher station. The lab 
is used in the CLEAR program only. 

The average time pupils worked at a computer station, compared with average 
pupil time in a program, is summarized in Table 14 by computer system and 
program. Time is reported as average minutes per week. 



Table 14 

Average Pupil Time at Computer Compared to Average 
Pupil Program Time in Chapter 1 CLEAR Labs 
Using Computer-Assisted Instruction 
1988-89 



Type 
of Lab 



Number 
of Labs 



Average Minutes 
Per Week 

At In 
Computer Program 



Percent 
Computer 
Time 



PL (Apple) 


22 


93.4 


214.1 


43.6 


PL (ILA) 


1 


125.0 


225.0 


55.6 


TRS-80 


2 


112.5 


237.5 


47.4 


Wasatch (Tandy) 


1 


75.0 


200.0 


37.5 


Wasatch (Sperry) 


1 


90.0 


225.0 


40.0 


CCC 


2 


150.0 


225.0 


66.7 


Total Elem. 


29 


93.8 


209.0 


44.9 


Middle School 










Oolphio 


3 


91.7 


203.3 


45.1 


Wasatch (Sperry) 


1 


100.0 


200.0 


50.0 


ESC (Tandy) 


3 


86.7 


208.3 


41.6 


Wicat 


1 


100.0 


200.0 


50.0 


Total MS 


8 


91.9 


204.4 


45.0 


Program Totals 


37 


93.4 


208.0 


44.9 
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Table 14 Indicates that, overall, pupils in CLEAR CAI/CMS labs received a 
bit l€M than half (between 40 and 50 percent) of their instruction at the 
computer stations. Previous observations and interviews indicate that a 
variety of individual and group teacher directed activities would account for 
the remaining program time. Three exceptions to the general range of 40 to 50 
percent can be seen at the elementary level. The average percent computer time 
for the one Wasatch Tandy lab was slightly below this range, at 37. 5Z. The 
range was exceeded in the one Prescription Learning ILA lab, at 55. 6Z, and in 
the two CCC labs at an average of 66. 7Z. 

The reader will note that at the middle school level there was a small 
discrepancy in the overall percent of time pupils work with computers as 
measured by the Evaluator^s Interview Log (38. OZ) and the computer census form 
(45. OZ). The percent derived from the computer census form is probably the 
more accurate because it was computed directly from average minutes per week at 
the computer compared to average minutes per week in the program, with no 
iTMrther variables to consider. The Evaluator's Interview LQg > on the other 
hand , asked teachers to compute percent of instructional time for 14 
activities, which may in practice overlap and intertwine. 

Summary 

A total of 4902 pupils was served by the CLEAR program during the 1988-89 
school year. Average daily membership in the overall program was 4000.1. 

The evaluation sample consisted of 2352 pupils who met the program 
attendance criterion, were English-speaking and received both the pretest and 
posttest. Grade 1 scores were not reported in the narrative or included in the 
total program averages due to the inappropriateness of the pretest and posttest 
levels. The MAT6 results may not reflect true pupil performance for certain 
programs and groups of pupils. Analysis of pretest-postt^^st achievement data 
for the grade 2-8 evaluation sample indicated an overall average gain of 5.9 
NCE points for the 5.7 month treatment period, or 1.0 NCE point per month of 
measurable instruction. This ziet the performance objective of an average 
growth of 1.0 NCE point per month for the overall program. When data were 
analyzed by grade, it was noted chat the evaluation criterion was met or 
exceeded in grade 3 (2.1 NCEs per month) and in grade 4 (1.3 NCEs per month). 
The remaining grades missed the criterion of 1.0 NCE per month with average 
monthly gains of 0.9 in grade 7, 0.7 in grade 6, 0.5 in grades 2 and 5, and 0.2 
in grade 8. It was evident I'/at there were some problems meeting the program-'s 
objective of 1.0 NCE average gain per month at most grade levels, which 
depressed the NCE point change for the overall program. 

The 1988-89 CLEAR program included two projects utilizing Computer Assisted 
Instruction/Computer Management Systen (CAI/CMS). In 26 elementary schools 
1078 pupila were served in CAI/CMS labs by 29 teachers. In middle school 
CAI/CMS labs 314 pupils in seven schools were served by 7 teachers. Evaluation 
sample sizes were 583 in elementary school and 151 in middle school. 

Both the CAI/CMS projects and the regular CLEAR projects met the program 
objective of an average gain of 1.0 NCS for every month of iD:itruction. Grade 
3 in both elementary projects had the greatest positive change in NCEs: regular 
12.3 NCEs overall or 2.2 per month, and CAI/CMS 10.7 NCEs overall or 1.9 per 
month. The other grade which met criterion in both CLEAR elementary projects 
was grade 4: 8.6 NCEs overall, 1.5 per month in regular CLEAR and 7.0 NCEs 
overall, 1.2 pjr month in the CAI/CMS project. The overall average change for 
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grades 2-7 in the CAI/CMS projects was 5.8 NCE points (grade 8 was not in the 
sample); in regular CLEAR (grades 2-8) the overall average change was 5.9 NCE 

pOiQtS* 

An additional comparison of treatment groups was made at the primary level 
where three distinct teaching methods were possible. For reasons previously 
stated scores for grade 1 were not included in these comparisons. At grade 2 
the Whole Language pilot group made an overall NCE change of 2.9 NCEs (0.5 NCE 
per month); CAI/CMS group 1.4 NCEs (0.2 NCE per month); and regular treatment 
group 3.6 NCEs (0.6 NCE per month). Grade 3 in all teaching method groups met 
criterion. The average overall changes in NCE scores for grade 3 for the three 
teaching methods were as follows: Whole Language pilot group 12.3 NCEs (2.2 
NCEs per month); CAI/CMS group 10.7 NCEs (1.9 NCEs per month); and regular 
treatment group 12.2 NCEs (2.1 NCEs per month). 

As already noted, NCE scores are based on percentiles, which compare the 
pupil's performance in relation to the general population. Even a soall gain 
in percentile or NCE score indicates that a pupil has progressed over the 
school year at a somewhat greater rate than would be expected from the pupil's 
original position in terms of the general population. 

The total number of program teachers was 128.0. The total number of 
full-time equivalency teachers (PTE) was 107.25. The number of teachers having 
master's degrees was 68, or 53. IZ of the teaching staff and one teacher (0.8Z) 
had a doctoral degree. The number of teachers having reading certification was 
64, or 50. OZ of the program teachers. CLEAR teachers reported an a-erage of 

years of Title I/Chapter 1 teaching experience, and an average of 20.8 
years of overall teaching experience. 

CLEAR teachers reported a total ci. e704.6 contacts with 3333.3 parents of 
program pupils involving 5327.4 parent hours. An additional 852.2 contacts 
were made with 643.4 parents who did not have children in the program involving 
901.0 parent hours. 

Positive ratings w^re given by CLEAR teachers to the Chapter 1 inservice 
sessions in which they participated. Inservice features receiving positive 
comments by program teachers included presentations by specific speakers, 
displays of new materials, coordinators' mini-sessions at the orientation 
meeting, a visit to a new type of CAI/CMS lab, a presentation by the Library 
Resource Center, sharing ideas and materials, hands-on activities with 
computers, and making books. The only item receiving five or more negative 
comments in a meeting concerned taking too much time answering questions 
dealing with individual problems. The only suggestion for future inservice 
topics with a frequency of five or more at a meeting was the area of parent 
involvement. 

Procsss evaluation was conducted in a se- 3 of on-site observations to the 
CLEAR-Primary pilot Whole Language units < f the regular CLEAR-Elementary 
project. On-site observations indicated strong evidence that the program was 
being implemented at the time of the visits. Program teachers expressed 
concern about how to coordinate with classroom tea^^hers given program 
scheduling problems. Of the five facets of program implementation that could 
be given an overall average rating, three had an average rating of 1.9 and two 
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had an average of 2.0 on a three-poinC scale where Compelling Evid ence was 
"ted (2). Some Evidence (1) and No Evidence (0). Several relatively minor 
problem* were reported to the appropriate Department of Federal and State 
Programs (DFSP) personnel. 

Interviews conducted with regular and CAI/CMS middle school teachers 
Indicated problems In the following areas: parent Involvement, joint planning 
with classroom teachers, temperature/ventilation In reading labs, testing 
environment during the posttest, delays In receiving test results, and delays 
In getting work-orders filled. The area of class scheduling received hleh 
ratings at the middle school level. 

A survey of CLEAR CAI/CMS teachers Indicated that a variety of computer 
systems was used In the CAI/CMS segments of the program. The most prevalent 
computer system was Prescription Uarnlng, which is used at the elementary 
level. For the most part, pupils worked at a computer station between ^0 and 
50 percent of their program Instructional time. 

The findings above Indicate that the 1988-89 CLEAR program attained the 
program performance objective In terms of NCE points. The overall average 
change for grades 2-8 was 5.9 NCE points or 1.0 NCE point per month. Grades 
making the most progress In terms of NCE points were grades 3 and 4. Other 
grades made 0.9 NCE points per month or less. Comparisons jere also made In 
regard to treatment group. The overall gain for the regular projects was 5.9 
NCE points (0.9 ptr month), while the overall gain In the CAI/CMS projects was 
5.8 NCE points (1.0 per month). Additional comparisons were made among thre. 
teaching methods In grades 2-3. Overall gains in NCE scores over the three 
different methods of teaching for the year were 7.3 NCEs or 1.3 NCEs per month. 

Given the overall findings for the program it is interesting to note how 
teachers rated their pupils' progress as students exited the program. When 
teachers were asked their opinion about whether their pupils had progressed 
'■'hile in the CLEAR program, program teachers felt that 80. 4Z of their pupils 
had made much or some progress. Only 19. 7Z of their pupils were rated as 
having made little or no progress in CLEAR. 



Recommendation s 

It is recommended that the CLEAR Program be continued during the 1989-90 
school year, with special consideration given to the following: 

I. Selection procedures. Instructional methods, class size, test 
content, and test norms should be reviewed to determine why 
pupils at some grade levels did not show desired growth, while 
pupils in other grades (3-4) showed disproportionately high 
growth. One course of action might be to concentrate program 
resources in those grades f.hat showed the most success. A more 
honest approach, however, would be to examine the 
apj/ropriateness of norms and content of the test to the target 
group. Should the norms or content of the present test not be 
deemed appropriate, alternative achievement tests should be 
considered. 
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2. The primary group using the Whole Language approach achieved 
results roughly comparable to the other two teaching methods 
used at that level. The Whole Language approach has 
demonstrated in its second year that it is a viable option 
within the program and should be continued* 

3. Methods for encouraging parent involvement need to be actively 
sought and successful methods shared* 

4* Reading materials should be sent home for the pupil to practice 
reading* Parent involvement should be elicited in this process. 

5. Efforts need to be made to improve coordination with classroom 
teachers and provide inservice and supervision to assure that 
this is occurring. Administrators and staff at the building 
level should develop a plan to insure that joint planning with 
program teachers is possible. 
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Table 15 

Minimum, Maximum, Median, and Standard Deviation 
of the Pretest and Pobt«"e8t Percentiles 
Reported by Grade Level 
1988-89 





Pupils 
in Sample 






Pretest 








PosttesL 




Grade 


Min. 


Max. 


Median 
Percentile 


Standard 
Deviation 


Min. 


Max. 


Median 
Percent ile 


Standard 
Deviat 1 on 


1 


200 


3.0 


86.0 


13.0 


12.8 


1.0 


99.0 


15.0 


27.7 


2 


513 


10.0 


91.0 


23.0 




1 n 
1 • u 


Q7 n 


24.0 


22. 3 


3 


484 


1.0 


75.0 


16.0 


14.6 


1.0 


92.0 


31.0 


17.4 


4 


292 


4.0 


80.0 


21.0 


16.7 


1.0 


84.0 


31.0 


16.3 


5 


214 


7.0 


78.0 


21.0 


15.6 


3.0 


67.0 


24.0 


15.3 


6 


576 


1.0 


82.0 


2^.0 


15.2- 


1.0 


97.0 


25.0 


14.9 


7 


60 


5.0 


54.0 


24.0 


11.9 


3.0 


79.0 


33.0 


16.4 


d 


13 


3.0 


68.0 


15.0 


17.9 


1.0 


57.0 


21.0 


17.3 
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Table 16 

Minlmim, Maximum, Median, and Standard Deviation 
of the Pretest and Posttest Grade Equivalents 
Reported by Grade Level 
1988-89 



Pretest 



Posttest 



Grade 


Pupils 
in Sample 


Mln. 


Max. 


Median 
Grade Equivalent 


Standard 
Deviation 


Min. 


Max. 


Median 


Standard 
uevletion 


1 


200 


0.0 


1.6 


0.4 


0.3 


0.2 


4.9 


1.3 


0.6 


2 


513 


1.4 


3.9 


1.6 


0.3 


1.3 


5.7 


2.1 


0.7 


3 


484 


1.5 


3.9 


2.0 


0.5 


1.5 


5.7 


3.0 


0.7 


4 


292 


2.0 


5.2 


2.7 


0.8 


1.7 


7.8 


3.9 


0.9 


5 


214 


2.1 


7.9 


3.6 


1.1 


2.1 


7.9 


4.3 


1.2 


6 


576 


2.1 


9.7 


4.4 


1.3 


2.1 


10.9 


4.9 


1.3 


7 


60 


4.0 


7.7 


5.0 


0.8 


2.5 


9.9 


5.8 


1.5 


8 


13 


4.0 


9.3 


4.7 


1.5 


4.0 


9.1 


5.9 


1.7 
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Table 17 

Minimum, Maximum, Median, and Standard Deviation 
of the Pretest and Posttest Percentiles Reported by Grade Level 
for Pupils Receiving Reading Instruction with Computers (CAI/CMS Groups) 
and Pupils Receiving Reading Instruction without Computers (Regular Groups) 

1988-89 



Grade 


Pupils 
In bample 






Pretest 








Posttest 




Min. 


Max* 


Median 
Percentile 


Sf andard 
Deviation 


Mln. 


Max. 


Median 
Percentile 


Standard 
Deviation 


CAI/C!i3 


Group 




















1 




9 


7.0 


i9.0 


14.0 


4.5 


1.0 


43.0 


15,0 


16.3 


2 




23 


10.0 


59.0 


23.0 


16. 1 


1.0 


94.0 


^ / • i/ 


oft 1 


3 




tit 

1 HH 


1.0 


68.0 


19.0 


16.0 


1.0 


89.0 


34.0 


15.9 


4 




^ 1 o 

229 


4.0 


80.0 


21.0 


16.7 


1.0 


78.0 


30.0 


15.8 


5 




1 78 


7.0 


78.0 


21.0 


15.5 


3.0 


67.0 


24. C 


15.4 


6 




i49 


i.O 


69.0 


20.0 


14.5 


1.0 


66.0 


25.0 


13.7 


7 




2 


18.0 


31.0 


24.5 


9.2 


13.0 


19.0 


16.0 


4.2 


H 




0 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


Regular Group 




















1 




VJl 


3.0 


86. 


18.0 


13.0 


1.0 


99.0 


15.0 


28.1 


2 




490 


10.0 


91.0 


23.0 


15.0 


1.0 


97.0 


24.0 


22.2 


3 




340 


1.0 


75.0 


16.0 


13.9 


1.0 


92.0 


31.0 


18.1 


4 




63 


4.0 


68.0 


24.0 


16.7 


1.0 


84.0 


35.0 


17.3 


5 




36 


7.0 


73.0 


22.5 


16.2 


3.0 


3.0 


2..0 


14.6 


6 




427 


1.0 


82.0 


22.0 


15.5 


1.0 


97.0 


25.0 


15.2 


7 




58 


5.0 


54.0 


24.0 


12.1 


3.0 


79.0 


33.5 


16.3 


8 




13 


3.0 


68.0 


15.0 


17.9 


1.0 


57.0 


21.0 


17.4 
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Table 18 

MlniffluiDi Maximum, Median » and Standard Deviation 
ot the Pretest and Posttest Grade Equivalents Reported by Grade Level 
for Pupils Receiving Reading Instruction with Computers (CAI/CMS Groups) 
and Pupils Receiving Reading Instruction without Computers (Regular Groups) 

1988-89 











Pretest 


-- 






Posttest 




Grade 


Pupils 
in Sample 


Min. 


Max. 


Median 
orade 
Equivalents 


Standard 
Deviation 


Min. 


Max. 


Median 
Grade 
Equivalent 


Standard 
Deviation 


CAI/CMS Groui 


















1 


9 


0.1 


0.4 


0.3 


0.1 


0,3 


1.6 


1.3 


0.5 


2 


23 


1.4 


2.3 


1.6 




1 1 


A Q 




U. 0 


3 


144 


1.5 


3.7 


2.1 


0.5 


1.5 


5.4 


3.1 


0.7 


4 


229 


2.0 


5.2 


2.7 


0.8 


1.7 


6.3 


3.8 


0.9 


5 


!78 


2.1 


7.9 


3.6 


1.1 


2.1 


7.9 


4.3 


1.2 


6 


149 


2.1 


8.6 


4.3 


1.2 


2,1 


8.7 


4.9 


1.2 


7 


2 


4.6 


5.4 


5.0 


0.6 


4.4 


4.9 


4.7 


0.4 


8 


0 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


NA 


Regular Group 


















1 


191 


0.0 


1.6 


0.4 


0.3 


0.2 


4.9 


1.3 


0.6 


2 


490 


1.4 


3.9 


1.6 


0.3 


1.3 


5.7 


2.1 


0.7 


3 


340 


1.5 


3.9 


2.0 


0.5 


1.5 


5.7 


3.0 


0.8 


4 


63 


2.0 


4.7 


2.9 


0.8 


1.7 


7.8 


4.1 


1.0 


5 


36 


2.1 


6.7 


3.7 


1.1 


2. I 


7.3 


4.5 


1.1 


6 


427 


2.1 


9.7 


4.4 


1.3 


2. 1 


10.9 


4.9 


1.3 


7 


58 


4.0 


7.7 


5.0 


0.8 


2.5 


9.9 


5.9 


1.5 


8 


13 


4.0 


9 3 


4.7 


1.5 


4.0 


9.1 


5.9 


1.7 
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COLUMBUS PUBLIC SCHOOLS Columbus, Ohio PUPIL CENSUS FORM 



iASI NA«4( 



flRSf NAMl 



llACHtR NUMBER 



SCHOOl 



YES UDT 1 



DID THIS^PUPIL BECOHE QUALIFIED m-r snmrEtT f^o^7 u U U U O 0 .0 



Q.2 9.9 QQ Q P Q ooooooooo ooooooooooooooooo 

FWCH PROGRESS 50ME PROGRESS LimETROGRESS NO PROGRESS 

OO0OO0OOOOO O00OOOQ OOOOOOOj^ OOP o o o O O O O O 

L - — Z 

O0O0OOOOO0OO0OOOOOOOOQQ QQ o o,o_o O O O O O O O r) 
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— rzr "j 
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AO 

1988-89 
Teacher Census Form 
Social Security Number 



Name 



Program Code 



School Aasigiuoent^ Cost Center 

Circle onli/ the program(s) you are in: 

ECIA Chapter 1 Programs: DPPF Programs: 

JiJ (10) Secondary Reading (Regular) 

(2) CLEAR-Reading Recovery (n) Secondary Reading (CAI) 

(3) CLEAR-Elementary (1-5) (12) HSCA 

(4 ) CLEAR-Element ar y-CAI 

(5) CLEAR-Middle (6-8) 

(6) CLEAR-Middle-CAI 

( 7 ) MIC-Elementary-CAI 

(8) MIC-aiddle-CAI Other (Specify) 

(9) Math-Pilot (3-8) (13) 



^Number of Years of Teaching Experience 

^Number of Years of Title I/Chapter 1 Teaching Experience 

am certified in reading as indicated by the subject area on my teaching 
certificate, 

Yes No 



Highest College Degree Received 



Full-Time Employee^ 

or 

Part-Time Employee 

DIRECTIONS: 

^Total all years of experience, including those which may have occurred 
outside of Columbus Public Schools. Please include ^resent school year. 
The timeline on the back of this page will help you m determining total 
number of years » 

^1. For every full yea- taught in Title I/Chapter 1 give yourself 10 
months experience. Please include the present school year. 

p.e timeline on the back oi this page vxJ 1 help you in determining 
the number of full years taught in Tide ^/Chapter 1. 

2. For every summer term you taught in Titie I/Chapter 1 give yourself two 
months experience. 

3. Add in any miscellaneous experience, a part-year perhaps. 

4. Add the totals for 1, 2, and 3 and divide by 10. Place the 
resulting quotient in the blank for question b above. 

^Certif ication is defined as having one of the following. 

1. reading specified on Bachelor degree. 

2. reading specialist certificate. 

3. M.A. in reading as a subject. 
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Timeline for Fifty Years of 
Continuous Teaching Experience 

School Total c^h^.i 
Year y^=^= * • School Total 

i£2^ "gacs Assignment Year 



1939- 40 _50_ 

1940- 41 49 

1941- 42 48 

1942- 43 kl 

1943- 44 46 

1944- 45 45 

1945- 46 44 

1946- 47 43 

1947- 48 42 

1948- 49 41 

1949- 50 40 

1950- 51 39 

1951- 52 38 

1952- 53 37 

1953- 54 36 

1954- 55 35 

1955- 56 34 
1936-57 33 

1957- 58 32 

1958- 59 31 

1959- 60 30 

1960- 61 29 

1961- 62 28 

1962- 63 27 

1963- 64 26 



Years Assl^^nment 



1964- 65 ^_25_ 

1965- 66 _24_ 

1966- 67 23 
196 7-68 22 

1968- 69 21 

1969- 70 20 

1970- 71 19 

1971- 72 18 

1972- 73 _17 

1973- 74 

1^^74-75 15 

1975- 76 14 

1976- 77 13 

1977- 78 12 

1978- 79 11 

1979- 80 _10 

1980- 81 9_ 

1981- 82 8 

1982- 83 7 

1983- 84 6^ 

1984- 85 5_ 

1985- 86 4 

1986- 87 3_ 

1987- 88 2__ 

1988- 89 1 
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CHAPTER i EVALUATION 
PARENT INVOLVEMENT SURVEY 



sailing label 
goes here 



Name 
School 



For the month of MAY, 1989 

(A) (B) 
Number of Total 
Parents Number of Hours 

1. Parents Involved In the planning, operation, 
and/ or evaluation of your unit 

2. Group Meetings for Parents 

3. Individual Parent Conferences 

(include phone conferences) " 

^. Parental Classroom Visits or Field Trips 

5. Visits by you to Parent Homes 

6, Totals 

^^^^^^^^ w^^M. * 

y. Estimated Unduplicated Count of Parents 



DIRECTIONS: 



1. Complete all information, fold over so back is showing, 
staple, and place in school mail. 

2. Place a parent in onJy one activity for any one meeting. 

3. Total hours equals the number of parents times the number of 
hours spent, e.g., a group meeting for 10 parents which lasts 
3 hours would result in 10 parents (Column A) and 30.0 hours 
(Colunn B), 15 parent conferences each for 30 minutes would 
result ia 15 parents and 7.5 hours. Please round all figures 
in Column B t o the nearest half hour. Enter half hours as 
.5» go fractions please. 

4. Item 7 - This is the number of different parents seen, not the 
total in 6A. If you had 16 parent conferences but 10 conferences 
were with the same parent, the unduplicated count is 7 parents - 
you saw 7 parents but had 16 conferences. Do not count a parent 
more than once. The figure in Item 7A can never exceed the 
figure in Item 6A. 
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PARENT INVOLVEMENT SURVEY 
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IMPORTANT 

- Enter on the line to the left the annual unduplicated count 

ANNUAL of parents you had involved in any of the Activities 1-5 

UNDUPLICATED beloi/. COUNT EACH PARENT ONLY ONCE FOR THE YEAR , If you 
COJNT have questions regarding this count, please call Jane 

Williams at 365-5167. 



COMPLETE THE REST OF THIS REPORT FOR JUNE ONLY* 



(A) (B) 
Number of Total 

Parents Number of Hours 
Activities ~~~~ 

1. Parents involved in the planning, operation, 
and/or evaluation of your unit 

2. Group Meetings for Parents 
3« Individual Parent Conferences 

4. Parental Classroom Visits or Field Trips 

5. Visits by you to Parent Homes 

6. Totals 

?• Estimated Unduplicated Count of Parents 

DIRECTIONS: K Complete all information, fold over so back is showing, 
staple, and place in school mail* 

2. Place a parent in only one activity for any one meeting. 

3. Total hours equals the number of parents times the number of 
hours spent, e.g., a group meeting for 10 parents which lasts 
3 hours would result in 10 parents (Column A) and 30.0 hours 
(Column B), 15 parent conferences each for 30 minutes would 
result in 15 parents and 7.5 hours. Please round all figures 
in Column B to the nearest half hour. Ent^r half hours as 
.5, no fractions plea«<. 

4. Item 7 - This is the nuab«r of different parents seen, not the 
total in 6A. If you had 16 parent conferences but 10 
conferences were with the sAae parent, the unduplicated count 
is 7 parents - you saw 7 parents but had 16 conferences. Do 
not count a parent more than once. The figure in Item 7A can 
never exceed the figure in Item 6A. 

RETURN RIGHT AWAY BUT NOT UTER THAN 

*Parent involvement data for the month of June must be estimated in order to meet tht 
deadline. 
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CHAPTER 1 EVALUATION 
PARENT INVOLVEMENT SURVEY 
SCHOOL YEAR ESTIMATE OF PARENTS 
NON-CHAPTER 1 STUDENTS 



Nam« 

School 

(A) (B) 

Number of Number of 

Activities P^r-^r^t-^ B ^ 

rarents Parent Hours 

1. Parents involved in the planning, oi oration, 
and/or evaluation of your unit (Do not include 

i'arent Advisory Council members.) 

2. Group Meetings for Parents (Do not include 

Parent Advisory Council meetings.) •* 

3. Individual Parent Conferences 

(include phone conferences) * 

4. Parental Classroom Visits or Field Trips 

5. Visits by you to Parer't Homes 

6. Estimated Unduplicated Count of Parents 



DIRECTIONS; Please complete all information. Indicate a 0 if the number of 
parents or hours is actually zero— otherwise enter the number. 

Column A (Number of Par ents) lines 1-5 ; Please place a parent in only 
one activity for any one meeting. 

Column B (Number of P arent Hours) lines 1-5 ; Indicate the sum of the 
hours each parent spent in an activity. For example, a group meeting 
with 10 parents which lasted 3 hours should result in a 10 on line 2 
Column A and a 30.0 on line 2, Column B (each parent met wUh the teacher 
3 hours and there were 10 parents). Please round all figures in 
Column B to the nearest half-hour. Enter half hours as .5. no f ractions 
please . ^— — ^— — 

For the Estimated Unduplicated Count of Parents do not count a parent more th^ 
once (even if a parent is listed in more than one activity). 

After completing all the information on this survey, fold it so the back i 
visible, staple, and place it in the school mail. 

Thank youe 
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EC I A CHAPTER 1 AND DPPF 
ORIENTATION INSERVICE EVALUATION FORM 
September 6» 1988 



Circle only the programCs) you are In: 



ECIA Chapter 1 Programs: DPPF Programs: 

(10) Secondary Reading (Regular) 

(2) CLEAR-Readlng Recovery (H) Secondary Reading (CAI) 

(3) CLEAR-Elementary (1-5) (12) HSCA 

( 4 ) CLEAR-E 1 eme nt ar y-CAI 

(5) CLEAR-Mlddle (6-8) 

(6) CLEAR-Mlddle-CAI 

(7) MIC-Elementary-CAI 

(8) MIC-Mlddle-CAI other (Specify) 

(9) Math-Pilot (3-8) (13) 



Circle Che number that Indicates the extent to which you agree with statements 1-4, In 
rating the overall day of lnservlce» 

Strongly Strongly 
Agree Agree Undecided Disagree Disagree 

1» I think this was a very worthwhile 

Inservice. 5 4 3 2 I 

2, rhe Information presented In this 
Inservice will assist me In my 

program, 5 4 3 2 1 

3, There was time to ask questions 

pertaining to the presentations, 5 4 3 2 1 

4, Questions were answered adequately, 5 4 3 2 1 

Circle the number that Indicates how you would rate each of the following portions of 
today's Inservice In regard to Interest and usefulness of presentations, 

S uperior Excellent Good Fair Poor 

5, Large Group Session 

a. Interest 5 4 3 2 1 

b. Usefulness 5 4 3 2 1 

* * 

* Please turn over for questions 6-12 * 

* * 



6t 
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Superior Excellent Good Fair 

6« Commercial Exhibits 

a* Interest 5 4 3 2 

b« Usefulness 5 4 3 2 

?• Mini-session with Main Speaker 

a* Interest 5 4 3 2 

b« Usefulness 5 4 3 2 

8. Program Coordinators' Mlnl-sesslon 

a» Interest 5 4 3 2 

b« Usefulness 5 4 3 2 



Poor 



Q. Clarity of in«**:ructlons 5 4 



3 2 



9« Evaluation Presentation 

a« Interest 5 4 3 2 

b« Usefulness 5 4 3 2 

c. Clarity of instructions 5 4 3 2 

10« What was the most valuable part of this meeting? 



ll« What was the least valuable part of this meeting? 



12. What additional Information or topics would you like to see covered In future 
meetings ' 



or 
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Inservlce Topic :^ 
PresenLervs)^ 
Date: / 



/ 



(e.g., 03/05/89) 



a.m. 



p .ai« 



MM DD YY 
Session (Check only one] all day 

Circle only the program(s} you are in: 

ECU Chapter 1 Programs: 

(1) ADK 

(2) CLEAR-Readlng Recovery 

(3) CLEAR-Primary (Special Treatment) 

(4) CLEAR-Elementary-Regular (1-5) 

(5) CLEAR-Elementary-CAI 

(6) CLEAR-Middle-Regular (6-8) 

(7) CLEAR-Middle-CAT 

(8) MIC-Eledientary-CAI 

(9) MIC-Mlddle-CAI 
(10) MIC-Exementary-Pilot (3-5) 
Ul) MIC-Kiddle-Pilrt (6-8) 

Circle the number that indicatet the extent to which you agree or disagree with 
statements 1-4. 



DPPF Programs: 

(12) Secondary Reading Program 
(Regular) 

(13) Secondary Reading Program 
(CAI) 

(14) HSCA 

Other (Specif>) 

(13; 



Strongly 
Agree 

1. I think this was a very worthwhile 
meeting. 5 

2. The ♦hfonnatlon presented in this 
meeting will assist me in my 

program. 5 

3. ^ere was time to ask questions 
pertaining to the presentation. 5 

4. Questions were answered 

adequately. 5 

5. What was the most valuable part of thi aeeting? 



Strongly 

ree Undecided Disagree Disagree 



4 



6. Wh&t was the least valuable part of tnig meeting? 



7. Please list any add I Clona l informati ^a or topics you 'fould like to ^ee covered in 
future meetings. ^[ 
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Columbus Public Schools 
DeparCmenC of Evaluation Services 

EVALUATOR'S VISITATION LOG 

Instructions for Using the Rating Scale 
and for Determining Kind of Evidence 

There are three response choices for rating the items on the instrument: 
(2) - Compelling Evidence , (1) Some Evidence , and (0) » No Evidence . 
Evidence Is of three kin^ls: ' — — — — 

(PE)-Physical Evidence - Examples of physical evidence are lesson 

plans, instructional materials, pictures 
of pupils on field trips, and a schedule 
of intramural activit'es, 

(OE)-Observational Evidence - This is evidence obtained from ob- 
serving the interactions among and between 
people and peoplrf, and people and things. 
Examples of thf.se interactions are teachers 
with pupil,, teachers with teachers, and 
pupils witii instructional materials- 

(TE)-Testimonial Evidence - Examples of testimonial evidence are 

teachers' and pupils' verbal and/or written 
comments regarding instructional activities 
that h- fe been carried out. 

When you read each item on the Evaluator's Visitation Log, pleaoe note 
the letters in parentheses which follow each item. These letters represent the 
most compelling kind of evidence available to the evaluator for that item. The 
designated evidence accompanying each item will help the evaluator determine 
the degree of evidence available for that item. 

If the designated compelling evidence is found, circle number (2). If 
compelling evidence is not found, look for one of the other kindfs of evidence. 
If one of the ot'.er kinds i^ founds circle number (1). If no evidence is 
found, circle (0). 

The following description of response choices is designed to provide soro^ 
uniformity *y the rating process. 

(2) ■ Compelling The evidence found is the designated one in 

Evidence parenthes^ i following the item. It is substantial 

and conclusive. The. evidence indicates that the 
item was b«inf fully implemented during the visit. 

(1) ■ Some Evidence it found, but it is not the designated 

Evidence evidence that it considered compelling. The 

evidence Indicates that the item was being 
partially iapleaented during the visit. 

(0) - No Evidence No physical observational, or testimonial evidence 

is found, rht evidence indicates that the item was 
not being Inplessented during the visit. 
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Columbus Public Schools 
Department of Evaluation Services 
ECIA-Chapte'- 1 Primary Program 



EVALUATOR'S VISITATION LOG 

School Program Teacher; 

Observer: ^ Date: ^Time: from to 

Grade(s) Observed: Number of PupUs in Class; 



Directions: Read each item. Notice which evidence in parentheses 1^ considered 
compelling. Tf Compelling Evidence i*' found, circle (2). If Compelling 
Evidence is not found, look for one of che other kinds of evidence. If 
you f^nri other evidence, circle the (1). Circle (0) 'f you find no evidence. 

Compelling Some No 
To what extent is chg re evidence that; Evidence Evidence Evidence 

Literate Environment for Pupils 

1. Pupil writings are displayed (PE). 2 1 Q 

2. Other reading materials - charts, 

experience stories, etc, - are placed 

where children can read them (PE). 2 10 

3. Room arrangement facilitates many reading 

options (PE). 2 10 

4 J Reading materials - books, etc- 

are accessible to pupils (PE). 2 1 0 

Comments ; 



Administrative Procedures and/or Record Keeping 

5. Running records are maintained for at least 

one class and are available for inspection (PE). 2 I 0 

6. Pupil personal data and attendance are recorded on 

t\ ' DPSP Student Data Form and are available for 

inspection (PE). 2 I 0 

7. Data from program selection tests are recorded and 

are available for inspection (PE). 2 1 0 

8. Class schedules are available and are up-to-date (PE). 2 1 0 
Comments ; 
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cm 



To what extent la there evidence that: 



Compelling Some No 
Evidence Evidence Evidence 



Materials and Facilities 

9* Holt materials are used for reading experiences (PE), 

10. Facility can accommodate flexible grouping for 
Instruction (PE)* 

!!• Reading experiences are provided through the use 
of supplemental materials (PE)« 



Comments ; 



Lesson Management (Activities, Variety. Direct Teaching 
Techniques ) 

Lesson Involves reading or writing of continuous text and Includes at least two 
of the following: 

12* Discussion or questioning of pupils relates to 
concepts, development of new Information, or 
prior knowledge (0E)« 



13. Teacher reads story to pupils (OE). 

14. Guided reading Includes questioning for reading 
strategies (OE). 

15. Teacher and pupils are Involved in group writing 

activity (CZ). 

16. Teacher administer© a Running Record (OE). 

17. Teacher and pupils read together (OE). 

18. Pupils are Involved In Independent writing 

activities (OE). 

1^. Pupils are involved In Independent reading 
activities with a partner or alone (OE). 



Comments: 



2 
2 



2 
2 
2 



0 
0 



0 
0 

0 
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To what extent is there evidence that: 



Instructional Efficiency and Monitoring 

20* Lesson plans are available (PE)* 

2K Instruction begins within three minutes after 
pupils are in room (OE)* 

22. Routines are established so pupils do not waste ^Ime 

waiting (OE). 

23. Positive feedback (verbal or written) is t sk 

specific (OE). 

2U. instruction is coordinated with at lea one class- 
room teacher as indicated by lesson plans PE)» 

25. A system is used for monitoring pupil progress of 
daily lessons such as writing samples, running 
records, anecdotal noten , etc* (PE)* 

Comme.»cs : 



Classroom Climate 

26. Verbal interactions are respected by teacher and 

pupils (OE). 

27. In general pupils are attentive to the ta^k (OE). 

28. All pupils are given the opportunity to respond (OE). 
Comments : 



Parent In^ ">lvement 

29. Reading materials are sent home for the student to 
oractice reading (!£)• 

30^ A sj'stem is used for communicating with parents, 

on a regular basis, abcut their chlld'i ■otivatlon 
and achievement: notation(s) on Student Data Form, 
newsletters, notes, etc. (PE)* 

Comments: 
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Columbus Public Schools 
DPPF-SRP and ECIA Chapter 1 Programs 

FVAT IlATnO'C TMTlTDTrTrTT t r\n 



CLEAR-Elem (1-5) 
CLEAR-Mid (6-8) 
DPPF-SRP (9-10) 



School 



Date 



Program Teacher 
Record Keeping 

1* DFSP Student Data Sheet 



Evaluator 



Adequate 
5 4 



General Comments about Record Keeping 



Pupil Progress 

2« Group Progress 



Much 
5 



General Comments about Pupli Progress 



Communication with Classroom 
Teacher 



3« Frequency 



Very 
Frequent 
5 4 



General Comments about Communication 
with Classroom Teacher 
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Coordination with Classroom 
Teacher 

4. Share Progress of Fupils 



5* Joint Planning 



General Comments about Coordlnatlca 
with Classroom Teacher 



Parent Involvement 

&• Responce to Effort i to Involve 

General Comments about Parent Involvement 



Always 

5 4 

Always 

5 4 



Large 

5 4 



Never 
1 

Never 

1 



Small 
1 



Selection of Pupils 
7* Problems 

Selection Test Cholcs 



None 
5 4 

'^ood 

3 4 



Many 
2 1 

Poor 
2 I 



9. Procedures 
10* Time Required 

General Comments about Selection of Pupils 



Class Scheduling 

11* Administrative Cooperation 
12* Teacher Cooperation 
13. Class Size 

General Comments about Class Scheduling 



Simple 
5 4 

Reasonable 
5 4 



G^od 
5 

5 

5 



4 
4 
4 



3 
3 
3 



Complex 
2 1 

Unreasonabl 
2 1 



2 
2 
2 



Poor 

1 

1 
1 



O 
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Testing 

14« Choice of Test 

15* Problems 

16 Procedures 

17. Tesf Sciiedullng 

18. Time Required 

General Comments about Testing 



Evaluation Feedback 
19* Amount 

20« Information 

21 Time Factor 
General Comments about Evaluation Feedback 



Good 

5 4 

None 

5 4 

Simple 
5 4 

Easy 

5 4 

Reasonable 

5 4 



Much 
5 4 

Useful 

5 4 

Timely 
5 4 



Poor 
2 1 

Many 

2 1 

Complex 
2 1 

Difficult 
2 1 

Unreasonable 

2 1 



None 
1 

Useless 
1 

Untimely 
1 



Materials 



22* Amount 



23* Levels 



24* Condition 
General Comments about Materials 



Adequate 

5 4 

Appropriate 
5 4 

New 
5 4 



Inadequate 
2 1 

Inappropriate 
2 1 

Old 
2 1 
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Pacllldes 



25. 


Space 


26. 


Light 


27. 


xcmptsraLurc/ vcnLiiaLion 


28. 


Noise Level 


29. 


Furniture 


30. 


Storage 



General Comments about Facilities 



Activities In Lab 

31. Percent of Student Time Spent 
In the Following Activities: 



a* 


Sustained Silent Reading 


b. 


Listening to a Lecture or a Story 


c* 


Listening to a Lecture and then 




Discussing 


d. 


Role Playing 


e. 


Participating in a Small Group 




Discussion 


f • 


Working at Learning Centers 




Giving Individual Student Reports 




or Reading Aloud 


h. 


Watching Demonstrations or Doin^^ 




Experiments 


1. 


Debating 


J* 


Participating in a Play or Skit 


k. 


Doiai Individual Seatwork 


1. 


Test Taking 


m« 


Doing Computer Activities 


n« 


Other 



Total Student Time 



O 
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MEMO 

TO; 

FROM; 

SuifJECT: 
DATE; 



CLEAR, MIC, and SRP Teachers Using Computer-Assisted 
Instruction (CAI) 

Ed Chamberlain (CLEAR-CAI and SRP-CAI evaluations) 
Phyl Thomas (MIC-CAI evaluations) 

Computer Systems Used in CAI Classrooms 

February 15, 1989 



Since there is a variety of different computer systems used in program 
classrooms, it is necessary for us to periodically rsse.ss rh^ distribution and 
use of these computer systems. Please take a few minutes to complete the form 
below, fold and staple with the return mailing? label showing, and return it in 
the school mail no later than February 28, 1989. 



Teacher 



School 



1. Please give the nttabeir of Computers 
or Terminals in your lab, by Jype 

Apple 
TRS-80 

Microhost 

Sperry 

Dolphin 
PET 

Other 



2. Please check the company 
servicing the computers 

Prescription Learning 

B&B 

CCC 

Wasatch 
Houghton-Mifflin 

None 

Other 



noes your computer system include a command module/teacher management 
system? Yes No 

How many computers (or terminals) are available in your lab for student 
work (do not include the Command Module)? 

The average number of minutes per week a pupil is served in the program 

(Reading program pupils) {Math program pupils) 

The average number of minutes per week a pupil works at a computer 



(Reading program pupil) 
Additional comments; 



(Math program pupil) 



cc; Dick Amorose 
Pose Carbol 
John Hi 11 lard 



Pat Huggard 
Dick Snide 
Jane WilllaM 
Dorothy Wilson 
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